You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 05:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #a, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackaslot5s.osadl.org (updated Mon Mar 16, 2026 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
811000,0rcu_preempt3-21ksoftirqd/021:40:130
81980,0rcu_preempt3-21ksoftirqd/000:38:240
81970,0rcu_preempt3-21ksoftirqd/022:47:330
81960,0rcu_preempt3-21ksoftirqd/022:37:270
81960,0rcu_preempt3-21ksoftirqd/020:43:270
81910,0rcu_preempt3-21ksoftirqd/020:34:210
81880,0rcu_preempt3-21ksoftirqd/021:25:410
81840,0rcu_preempt3-21ksoftirqd/021:19:460
10050810,0irq/346-48484002006-1kworker/1:1H23:00:591
81740,0rcu_preempt15431-21apt-get19:14:090
10050740,0irq/346-484840041ktimersoftd/022:53:160
81730,0rcu_preempt20631-21diskmemload23:43:060
1364499739,0cyclictest0-21swapper/022:11:050
1364499737,0cyclictest3-21ksoftirqd/022:26:170
13250720,0irq/301-48020003-21ksoftirqd/000:09:110
81700,0rcu_preempt3-21ksoftirqd/000:07:220
1364499692,0cyclictest0-21swapper/021:32:160
81680,0rcu_preempt3-21ksoftirqd/023:59:170
1364499682,0cyclictest0-21swapper/021:56:540
81670,0rcu_preempt3-21ksoftirqd/023:55:440
81670,0rcu_preempt3-21ksoftirqd/023:19:100
81670,0rcu_preempt19-21ksoftirqd/100:01:341
81660,0rcu_preempt19-21ksoftirqd/122:24:121
1364499662,0cyclictest54-21kswapd023:00:020
1364499662,0cyclictest0-21swapper/023:45:020
10050660,0irq/346-484840028381-21taskset23:27:401
81650,0rcu_preempt27120-21diskstats19:49:140
1364499654,0cyclictest0-21swapper/023:34:120
10050650,0irq/346-484840021385-1kworker/1:1H00:26:471
1364499642,0cyclictest0-21swapper/021:35:530
1364499642,0cyclictest0-21swapper/021:17:570
1364499641,0cyclictest5997-21cat21:59:200
81630,0rcu_preempt18249-21ssh22:44:201
1364499632,0cyclictest0-21swapper/000:21:410
1364499631,0cyclictest15210-21munin-node0
81620,0rcu_preempt5570-21if_eth323:04:201
81620,0rcu_preempt4985-21apt-get23:04:110
81620,0rcu_preempt19-21ksoftirqd/119:39:371
81620,0rcu_preempt19-21ksoftirqd/119:39:371
1364499626,0cyclictest29637-21apt-get23:29:090
1364499622,0cyclictest31447-21ssh22:58:040
1364499622,0cyclictest20221-21taskset19:28:590
1364499622,0cyclictest0-21swapper/020:54:130
1364499621,0cyclictest12269-21php-cgi22:05:170
10050620,0irq/346-4848400857-1kworker/1:0H21:48:191
81610,0rcu_preempt3-21ksoftirqd/019:39:060
81610,0rcu_preempt3-21ksoftirqd/019:39:060
81610,0rcu_preempt3-21ksoftirqd/000:14:250
13644996117,0cyclictest24938-21munin-node0
13644996112,0cyclictest26040-21munin-node0
1364499611,0cyclictest20411-21unixbench_singl00:24:270
1364499611,0cyclictest14552-1kworker/0:3H22:41:030
10050610,0irq/346-48484009212-1kworker/1:1H23:42:451
10050610,0irq/346-4848400857-1kworker/1:0H21:25:471
10050610,0irq/346-484840023405-1kworker/1:1H21:11:101
81600,0rcu_preempt3-21ksoftirqd/021:04:210
81600,0rcu_preempt3-21ksoftirqd/019:58:590
1364499602,0cyclictest23832-21ssh21:11:430
1364499602,0cyclictest0-21swapper/020:29:120
1364499601,0cyclictest8073-1kworker/0:3H22:29:350
10050600,0irq/346-48484005381-1kworker/1:0H22:40:571
81590,0rcu_preempt4628-21php-cgi20:19:180
1364499592,0cyclictest26173-21taskset21:46:550
1364499592,0cyclictest20371-21tr22:14:110
1364499592,0cyclictest0-21swapper/000:33:240
10050590,0irq/346-48484005381-1kworker/1:0H22:35:331
10050590,0irq/346-484840028338-1kworker/1:2H21:18:251
81580,0rcu_preempt3-21ksoftirqd/020:09:310
81580,0rcu_preempt30877-21ssh00:35:101
81580,0rcu_preempt19-21ksoftirqd/123:45:251
1364499588,0cyclictest0-21swapper/023:49:160
1364499582,0cyclictest0-21swapper/020:04:180
10050580,0irq/346-484840031237-21ssh23:29:551
10050580,0irq/346-484840030604-1kworker/1:3H22:06:091
10050580,0irq/346-484840014992-1kworker/1:3H21:40:011
81570,0rcu_preempt19-21ksoftirqd/123:55:551
1364499579,0cyclictest10790-1kworker/0:1H21:49:280
13644995714,0cyclictest11491-21ssh23:09:550
1364499571,0cyclictest29803-21ping19:59:180
10050570,0irq/346-484840011910-1kworker/1:3H23:14:261
81560,0rcu_preempt19-21ksoftirqd/123:20:341
81560,0rcu_preempt19-21ksoftirqd/120:29:511
1364499562,0cyclictest3907-1kworker/0:0H20:18:590
1364499562,0cyclictest3907-1kworker/0:0H20:18:590
1364499562,0cyclictest18986-1kworker/0:0H21:03:580
1364499562,0cyclictest15293-21latency_hist19:13:590
1364499562,0cyclictest0-21swapper/020:49:270
13644995610,0cyclictest0-21swapper/019:44:250
10050560,0irq/346-484840017993-1kworker/1:1H22:15:561
81550,0rcu_preempt19-21ksoftirqd/119:31:051
10050550,0irq/346-484840054-21kswapd022:03:461
10050550,0irq/346-484840026737-1kworker/1:1H23:34:521
10050540,0irq/346-484840054-21kswapd021:19:481
10050540,0irq/346-484840026305-1kworker/1:0H00:33:301
10050540,0irq/346-484840017993-1kworker/1:1H22:12:101
81530,0rcu_preempt19-21ksoftirqd/122:21:241
1364499532,0cyclictest21960-21runrttasks19:34:000
1364499532,0cyclictest16932-21ping19:29:120
1364499532,0cyclictest16932-21ping19:19:090
1364499532,0cyclictest16932-21ping19:19:090
10050530,0irq/346-4848400372-1kworker/1:1H22:29:081
10050530,0irq/346-484840029447-1kworker/1:2H22:55:511
10050530,0irq/346-484840011460-1kworker/1:1H00:20:011
81520,0rcu_preempt19-21ksoftirqd/121:32:121
81520,0rcu_preempt13606-21users20:44:270
13644995210,0cyclictest0-21swapper/020:24:180
10050520,0irq/346-484840024897-1kworker/1:2H21:53:031
10050520,0irq/346-484840019115-1kworker/1:0H23:51:571
10050520,0irq/346-484840011910-1kworker/1:3H23:10:311
81510,0rcu_preempt19-21ksoftirqd/121:54:451
81510,0rcu_preempt0-21swapper/122:50:481
10050510,0irq/346-48484006510-1kworker/1:2H00:12:121
81500,0rcu_preempt19-21ksoftirqd/120:39:081
81500,0rcu_preempt19-21ksoftirqd/100:04:041
10050500,0irq/346-484840014992-1kworker/1:3H21:35:251
81480,0rcu_preempt19-21ksoftirqd/120:09:001
10050480,0irq/346-484840010670-21ssh00:14:361
13644994710,0cyclictest0-21swapper/019:08:580
10050470,0irq/346-484840014980-1kworker/1:1H19:11:021
81460,0rcu_preempt29803-21ping20:18:591
81460,0rcu_preempt29803-21ping20:18:591
81430,0rcu_preempt19-21ksoftirqd/119:39:001
81430,0rcu_preempt19-21ksoftirqd/119:24:111
10050430,0irq/346-484840016932-21ping19:19:211
10050430,0irq/346-484840016932-21ping19:19:211
81410,0rcu_preempt25271-21munin-node1
81410,0rcu_preempt19-21ksoftirqd/119:58:591
81410,0rcu_preempt17399-21ls20:58:591
81400,0rcu_preempt19-21ksoftirqd/121:01:311
81400,0rcu_preempt19-21ksoftirqd/120:34:501
10050390,0irq/346-48484000-21swapper/120:49:181
9950380,0irq/345-484840020633-21ls21:08:591
81380,0rcu_preempt19-21ksoftirqd/119:08:121
9950360,0irq/345-484840019-21ksoftirqd/120:05:241
81360,0rcu_preempt19-21ksoftirqd/120:44:171
81360,0rcu_preempt19-21ksoftirqd/119:13:591
81360,0rcu_preempt0-21swapper/120:19:201
81350,0rcu_preempt19-21ksoftirqd/120:28:591
81350,0rcu_preempt19-21ksoftirqd/119:59:461
10050350,0irq/346-484840054-21kswapd019:49:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional