You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 09:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #a, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot5s.osadl.org (updated Sat Dec 27, 2025 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
811490,0rcu_preempt19-21ksoftirqd/119:45:371
811200,0rcu_preempt3-21ksoftirqd/021:59:090
811120,0rcu_preempt24119-21diskmemload00:31:221
811120,0rcu_preempt19-21ksoftirqd/100:10:061
811120,0rcu_preempt17244-21cyclictest23:49:241
811110,0rcu_preempt24119-21diskmemload22:43:311
811100,0rcu_preempt17244-21cyclictest23:09:051
811090,0rcu_preempt19-21ksoftirqd/121:49:121
811040,0rcu_preempt19-21ksoftirqd/123:51:521
81990,0rcu_preempt20869-1kworker/1:1H23:32:561
81990,0rcu_preempt19-21ksoftirqd/119:39:591
26422960,0sleep010050irq/346-484840020:02:460
81940,0rcu_preempt19-21ksoftirqd/119:30:081
81940,0rcu_preempt19-21ksoftirqd/119:30:081
43282940,0sleep010050irq/346-484840020:08:220
43282940,0sleep010050irq/346-484840020:08:220
81910,0rcu_preempt20505-1kworker/1:2H22:14:211
81770,0rcu_preempt16963-21kworker/0:222:24:230
81770,0rcu_preempt16963-21kworker/0:222:24:230
81760,0rcu_preempt19-21ksoftirqd/123:35:231
81750,0rcu_preempt3-21ksoftirqd/022:19:560
59012740,0sleep010050irq/346-484840020:12:440
81690,0rcu_preempt3-21ksoftirqd/020:55:260
81650,0rcu_preempt3-21ksoftirqd/021:00:260
81640,0rcu_preempt6848-21kworker/0:122:33:110
28922640,0sleep19950irq/345-484840023:11:291
28922640,0sleep19950irq/345-484840023:11:291
10050630,0irq/346-48484007521-1kworker/0:3H23:19:420
81620,0rcu_preempt3-21ksoftirqd/022:55:280
81620,0rcu_preempt3-21ksoftirqd/022:40:270
81610,0rcu_preempt3-21ksoftirqd/023:14:400
81610,0rcu_preempt3-21ksoftirqd/023:14:400
81610,0rcu_preempt3-21ksoftirqd/022:35:280
81610,0rcu_preempt3-21ksoftirqd/020:24:560
81610,0rcu_preempt18552-1kworker/0:3H19:25:320
198802610,0sleep19950irq/345-484840022:16:591
106872610,0sleep010050irq/346-484840020:26:180
81600,0rcu_preempt3-21ksoftirqd/022:49:170
81600,0rcu_preempt3-21ksoftirqd/021:35:210
81600,0rcu_preempt3-21ksoftirqd/000:25:080
81600,0rcu_preempt23389-21apt-get21:45:080
76662600,0sleep010050irq/346-484840020:19:100
81590,0rcu_preempt3-21ksoftirqd/021:54:410
81590,0rcu_preempt3-21ksoftirqd/021:20:110
81590,0rcu_preempt19-21ksoftirqd/123:00:241
81580,0rcu_preempt3-21ksoftirqd/023:45:300
81580,0rcu_preempt3-21ksoftirqd/023:35:180
81580,0rcu_preempt3-21ksoftirqd/023:25:090
81580,0rcu_preempt3-21ksoftirqd/000:20:220
81580,0rcu_preempt0-21swapper/022:00:540
81570,0rcu_preempt3-21ksoftirqd/023:44:510
81570,0rcu_preempt3-21ksoftirqd/023:01:450
81570,0rcu_preempt3-21ksoftirqd/021:32:280
81570,0rcu_preempt19-21ksoftirqd/120:00:001
10050570,0irq/346-484840018010-21ssh00:05:230
81560,0rcu_preempt3-21ksoftirqd/023:06:150
81560,0rcu_preempt19-21ksoftirqd/121:50:211
81560,0rcu_preempt0-21swapper/021:41:000
81540,0rcu_preempt3-21ksoftirqd/023:34:350
10050540,0irq/346-484840020992-1kworker/0:3H21:13:290
81530,0rcu_preempt3-21ksoftirqd/021:26:520
81530,0rcu_preempt3-21ksoftirqd/000:36:060
81530,0rcu_preempt24113-1kworker/1:0H21:10:171
10050530,0irq/346-48484008874-1kworker/0:1H22:06:580
81520,0rcu_preempt19-21ksoftirqd/120:50:121
81510,0rcu_preempt3-21ksoftirqd/023:55:080
81510,0rcu_preempt19-21ksoftirqd/100:00:271
81510,0rcu_preempt13076-21php-cgi20:35:130
284322510,0sleep19950irq/345-484840022:26:351
206652510,0sleep010050irq/346-484840019:19:590
10852510,0sleep010050irq/346-484840019:59:040
81500,0rcu_preempt19-21ksoftirqd/121:40:131
81500,0rcu_preempt14463-21apt-get20:40:070
81500,0rcu_preempt14463-21apt-get20:40:070
81490,0rcu_preempt4364-21apt-get22:00:081
81490,0rcu_preempt3-21ksoftirqd/022:29:430
81490,0rcu_preempt3-21ksoftirqd/022:13:480
81490,0rcu_preempt22656-1kworker/1:1H22:20:301
81490,0rcu_preempt22656-1kworker/1:1H22:20:301
81490,0rcu_preempt19-21ksoftirqd/123:20:061
10050490,0irq/346-48484000-21swapper/023:20:270
81480,0rcu_preempt3-21ksoftirqd/021:16:390
81480,0rcu_preempt3-21ksoftirqd/021:16:390
81480,0rcu_preempt19-21ksoftirqd/123:29:021
1724599481,0cyclictest20514-21ping19:40:080
10050480,0irq/346-484840025253-21sshd19:33:140
10050480,0irq/346-484840025253-21sshd19:33:140
10050480,0irq/346-48484000-21swapper/000:19:570
81470,0rcu_preempt3-21ksoftirqd/000:01:290
81470,0rcu_preempt1001-21thttpd00:30:290
111470,0rcuc/013719-1kworker/0:1H22:50:160
111470,0rcuc/013719-1kworker/0:1H22:50:160
10050470,0irq/346-48484001797-1kworker/0:0H23:50:180
81460,0rcu_preempt15267-1kworker/1:1H21:39:571
10050460,0irq/346-484840021776-21wget00:10:100
10050460,0irq/346-484840020514-21ping19:47:120
10050460,0irq/346-484840020514-21ping19:38:430
10050460,0irq/346-484840015748-21munin-node0
81450,0rcu_preempt19-21ksoftirqd/122:05:281
81450,0rcu_preempt19-21ksoftirqd/120:20:131
111822450,0chrt9950irq/345-484840020:30:081
111822450,0chrt9950irq/345-484840020:30:081
111450,0rcuc/031646-1kworker/0:1H19:54:560
81440,0rcu_preempt4293-1kworker/1:0H00:38:241
81430,0rcu_preempt19-21ksoftirqd/122:30:251
81430,0rcu_preempt17220-1kworker/1:0H19:10:231
304252430,0sleep19950irq/345-484840023:43:001
10050430,0irq/346-484840020992-1kworker/0:3H21:05:170
10050430,0irq/346-484840015638-1kworker/0:3H20:45:220
81420,0rcu_preempt19-21ksoftirqd/123:59:491
81420,0rcu_preempt19-21ksoftirqd/119:39:571
81420,0rcu_preempt19-21ksoftirqd/100:19:571
81420,0rcu_preempt17244-21cyclictest22:54:321
81420,0rcu_preempt17244-21cyclictest22:54:321
65822420,0chrt9950irq/345-484840022:39:221
10050420,0irq/346-484840041ktimersoftd/020:30:260
10050420,0irq/346-484840041ktimersoftd/020:30:260
10050420,0irq/346-484840018552-1kworker/0:3H19:14:570
10050420,0irq/346-484840015638-1kworker/0:3H20:50:160
10050410,0irq/346-484840018552-1kworker/0:3H19:14:290
9950400,0irq/345-484840016784-21munin-node1
81400,0rcu_preempt19-21ksoftirqd/123:16:341
81390,0rcu_preempt24119-21diskmemload22:55:251
81390,0rcu_preempt19-21ksoftirqd/121:25:121
81390,0rcu_preempt19-21ksoftirqd/121:19:511
81390,0rcu_preempt19-21ksoftirqd/121:19:511
81380,0rcu_preempt19-21ksoftirqd/121:55:071
81380,0rcu_preempt19-21ksoftirqd/100:24:461
81370,0rcu_preempt19-21ksoftirqd/119:19:591
81370,0rcu_preempt17244-21cyclictest00:27:091
9950360,0irq/345-484840020863-21sendmail-msp20:59:581
10050360,0irq/346-48484005803-1kworker/1:2H20:15:161
9950350,0irq/345-48484002835-21php-cgi21:21:241
9950350,0irq/345-48484000-21swapper/122:45:481
81350,0rcu_preempt19570-1kworker/1:3H00:07:091
9950340,0irq/345-48484003197-21munin-node1
9950340,0irq/345-48484003197-21munin-node1
10050340,0irq/346-48484009093-1kworker/1:3H20:24:581
10050340,0irq/346-484840024113-1kworker/1:0H21:30:161
58332330,0sleep15803-1kworker/1:2H20:11:591
205952330,0chrt15639-1kworker/1:3H20:57:211
10050330,0irq/346-484840022308-21apt-get19:25:081
10050330,0irq/346-484840019254-21fschecks_count19:15:131
316952320,0sleep130015-1kworker/1:2H19:52:081
10050320,0irq/346-484840015640-1kworker/1:4H20:45:141
9950310,0irq/345-48484000-21swapper/120:40:131
9950310,0irq/345-48484000-21swapper/120:40:131
7852310,0sleep1637-1kworker/1:0H19:56:051
10050310,0irq/346-484840022186-1kworker/1:2H21:05:201
10050300,0irq/346-484840012360-1kworker/1:1H20:35:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional