You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 02:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Thu Jul 02, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450740,0irq/25-eth10-21swapper/318:47:493
2676123823,0sleep00-21swapper/018:50:110
2645223425,0sleep10-21swapper/118:46:311
2681623329,0sleep20-21swapper/218:50:492
35160,0ktimersoftd/30-21swapper/300:11:213
29725060,0irq/27-eth0-tx-4303-21munin-node20:11:200
29715060,0irq/26-eth0-rx-22965-21yum22:46:263
29715060,0irq/26-eth0-rx-16783-21ssh22:25:273
27160,0ktimersoftd/20-21swapper/223:13:402
269069966,0cyclictest0-21swapper/222:51:192
269069960,0cyclictest0-21swapper/221:10:342
19160,0ktimersoftd/10-21swapper/123:50:231
149960,0migration/07011-21sh23:38:490
149960,0migration/06335-21sh22:56:220
149960,0migration/031698-21sh22:32:380
149960,0migration/026959-21kthreadcore22:51:170
149960,0migration/022437-21sh23:47:010
149960,0migration/019985-21kthreadcore21:46:180
35150,0ktimersoftd/30-21swapper/323:13:403
339950,0migration/39846-21if_eth1.322:41:183
339950,0migration/37670-21unixbench_multi21:16:263
339950,0migration/37117-21kthreadcore19:21:193
339950,0migration/35466-21munin-node20:36:143
339950,0migration/329707-21munin-node23:51:223
339950,0migration/328245-21aten2.4-expect19:16:143
339950,0migration/325876-21munin-node21:51:133
339950,0migration/325679-21munin-node22:31:153
339950,0migration/324950-21runrttasks21:09:523
339950,0migration/319574-21kthreadcore19:31:193
339950,0migration/31922-21idleruntime22:16:153
339950,0migration/318144-21taskset20:42:453
339950,0migration/317470-21aten_r1power_fr22:06:143
339950,0migration/315224-21munin-node21:41:223
339950,0migration/312689-21kthreadcore00:01:193
339950,0migration/31188-21kthreadcore19:41:203
29725050,0irq/27-eth0-tx-8592-21munin-node23:01:182
29725050,0irq/27-eth0-tx-6902-21port_sshpriv21:56:212
29725050,0irq/27-eth0-tx-29074-21munin-node19:41:150
29725050,0irq/27-eth0-tx-13258-21ssh21:41:182
29725050,0irq/27-eth0-tx-0-21swapper/223:16:382
29725050,0irq/27-eth0-tx-0-21swapper/223:16:382
29725050,0irq/27-eth0-tx-0-21swapper/222:07:102
29715050,0irq/26-eth0-rx-9186-21irqcore19:01:173
29715050,0irq/26-eth0-rx-8848-21cpuspeed_turbos23:01:153
29715050,0irq/26-eth0-rx-8116-40yum-updatesd-he22:39:503
29715050,0irq/26-eth0-rx-7014-21ssh23:38:503
29715050,0irq/26-eth0-rx-529-21munin-node23:56:153
29715050,0irq/26-eth0-rx-4424-21aten2.4-expect20:11:133
29715050,0irq/26-eth0-rx-26755-21kthreadcore23:31:173
29715050,0irq/26-eth0-rx-23175-21ssh23:28:243
29715050,0irq/26-eth0-rx-23054-21load21:26:203
29715050,0irq/26-eth0-rx-1283-21df_abs20:56:153
29715050,0irq/26-eth0-rx-0-21swapper/323:46:083
29715050,0irq/26-eth0-rx-0-21swapper/323:41:183
29715050,0irq/26-eth0-rx-0-21swapper/323:21:563
29715050,0irq/26-eth0-rx-0-21swapper/323:07:033
29715050,0irq/26-eth0-rx-0-21swapper/322:11:183
29715050,0irq/26-eth0-rx-0-21swapper/322:04:043
29715050,0irq/26-eth0-rx-0-21swapper/321:57:493
29715050,0irq/26-eth0-rx-0-21swapper/321:48:263
29715050,0irq/26-eth0-rx-0-21swapper/321:31:133
29715050,0irq/26-eth0-rx-0-21swapper/321:21:193
29715050,0irq/26-eth0-rx-0-21swapper/321:11:083
29715050,0irq/26-eth0-rx-0-21swapper/319:51:133
29715050,0irq/26-eth0-rx-0-21swapper/300:16:183
269069955,0cyclictest0-21swapper/223:50:172
269069955,0cyclictest0-21swapper/221:14:022
269069955,0cyclictest0-21swapper/200:10:372
269069954,0cyclictest3514-21snmpd23:00:172
269069950,0cyclictest0-21swapper/223:58:002
269069950,0cyclictest0-21swapper/219:41:202
269059955,0cyclictest0-21swapper/123:19:111
269059955,0cyclictest0-21swapper/123:19:111
269059955,0cyclictest0-21swapper/123:07:031
269059955,0cyclictest0-21swapper/122:01:091
269059950,0cyclictest0-21swapper/123:12:151
269059950,0cyclictest0-21swapper/121:45:421
269059950,0cyclictest0-21swapper/121:12:071
259950,0migration/230493-21latency22:31:202
259950,0migration/213767-21rt-features23:41:212
259950,0migration/211975-21if_eth120:16:172
249950,0watchdog/20-21swapper/222:15:562
149950,0migration/09561-21fschecks_count19:26:160
149950,0migration/08349-21sh20:59:350
149950,0migration/08323-21munin-node23:21:110
149950,0migration/07558-21taskset22:17:020
149950,0migration/07226-21switchtime21:36:240
149950,0migration/06491-21taskset23:16:360
149950,0migration/06491-21taskset23:16:360
149950,0migration/05943-21kthreadcore21:56:180
149950,0migration/03440-21kthreadcore20:31:190
149950,0migration/031880-21runrttasks21:11:280
149950,0migration/031362-21kthreadcore20:06:190
149950,0migration/030768-21kthreadcore19:16:190
149950,0migration/026787-21kthreadcore23:31:170
149950,0migration/023456-21aten2.4-expect20:01:120
149950,0migration/021673-21kthreadcore23:06:180
149950,0migration/019660-21kthreadcore21:26:180
149950,0migration/019323-21kthreadcore19:56:200
149950,0migration/018529-21munin-node20:21:170
149950,0migration/018478-21irqcore22:06:180
149950,0migration/016002-21ksmtuned22:23:150
149950,0migration/015121-21taskset23:44:070
149950,0migration/011474-21sh22:41:200
149950,0migration/010966-21kthreadcore21:01:160
149950,0migration/010542-21fschecks_count19:51:150
8215040,0irq/24-0000:00:17251-21latency_hist21:46:022
4140,0ktimersoftd/00-21swapper/023:11:560
339940,0migration/33221-21kthreadcore21:36:183
339940,0migration/332148-21irqcore20:31:183
339940,0migration/328169-21kthreadcore20:01:183
339940,0migration/322801-21kthreadcore20:21:203
339940,0migration/321342-21ntp_kernel_err00:06:213
339940,0migration/31625-21irqcore22:56:163
339940,0migration/310421-21kthreadcore19:26:193
29725040,0irq/27-eth0-tx-31687-21ssh20:52:292
29725040,0irq/27-eth0-tx-26642-21if_eth021:31:172
29725040,0irq/27-eth0-tx-15854-21telnet19:31:130
29725040,0irq/27-eth0-tx-0-21swapper/223:31:062
29725040,0irq/27-eth0-tx-0-21swapper/222:26:332
29725040,0irq/27-eth0-tx-0-21swapper/222:16:372
29725040,0irq/27-eth0-tx-0-21swapper/221:52:392
29725040,0irq/27-eth0-tx-0-21swapper/221:16:042
29725040,0irq/27-eth0-tx-0-21swapper/220:56:172
29725040,0irq/27-eth0-tx-0-21swapper/200:11:112
29725040,0irq/27-eth0-tx-0-21swapper/020:26:140
29725040,0irq/27-eth0-tx-0-21swapper/019:06:140
29715040,0irq/26-eth0-rx-0-21swapper/323:16:143
29715040,0irq/26-eth0-rx-0-21swapper/323:16:143
29715040,0irq/26-eth0-rx-0-21swapper/322:52:343
29715040,0irq/26-eth0-rx-0-21swapper/322:26:083
29715040,0irq/26-eth0-rx-0-21swapper/321:01:433
29715040,0irq/26-eth0-rx-0-21swapper/320:51:183
29715040,0irq/26-eth0-rx-0-21swapper/318:56:153
269069944,0cyclictest0-21swapper/223:37:212
269069944,0cyclictest0-21swapper/218:56:242
269069944,0cyclictest0-21swapper/200:01:092
269069943,0cyclictest4329-21awk19:46:162
269069943,0cyclictest3556-21lldpd19:58:392
269069943,0cyclictest3514-21snmpd23:51:022
269069943,0cyclictest3514-21snmpd23:29:472
269069943,0cyclictest3514-21snmpd19:25:322
269069943,0cyclictest3514-21snmpd18:56:022
269069943,0cyclictest3241-21irqbalance23:21:102
269069943,0cyclictest3241-21irqbalance22:36:402
269069943,0cyclictest3241-21irqbalance22:01:102
269069943,0cyclictest29100-21awk19:16:182
269069943,0cyclictest17778-21awk22:46:172
269069943,0cyclictest17592-21awk23:06:152
269069943,0cyclictest10070-21awk21:01:142
269069943,0cyclictest0-21swapper/221:21:132
269069940,0cyclictest0-21swapper/200:16:172
269059944,0cyclictest0-21swapper/120:56:121
269059944,0cyclictest0-21swapper/120:52:251
269059943,0cyclictest610-21awk23:56:151
269059943,0cyclictest3556-21lldpd22:10:411
269059943,0cyclictest3556-21lldpd00:06:101
269059943,0cyclictest3514-21snmpd19:48:321
269059943,0cyclictest3514-21snmpd19:05:171
269059943,0cyclictest3241-21irqbalance22:46:301
269059943,0cyclictest3241-21irqbalance22:31:101
269059943,0cyclictest3241-21irqbalance21:55:401
269059943,0cyclictest3241-21irqbalance20:42:201
269059943,0cyclictest3241-21irqbalance20:31:401
269059943,0cyclictest3241-21irqbalance20:26:101
269059943,0cyclictest3241-21irqbalance20:16:201
269059943,0cyclictest3241-21irqbalance19:58:201
269059943,0cyclictest30956-21awk20:06:171
269059943,0cyclictest28837-21sadc19:41:021
269059943,0cyclictest2317-21awk18:56:181
269059943,0cyclictest2051-21awk21:56:151
269059943,0cyclictest19623-21awk20:46:161
269059943,0cyclictest18571-21tail22:26:171
269059943,0cyclictest10134-21awk22:21:161
269049944,0cyclictest0-21swapper/022:38:420
269049943,0cyclictest5303-21munin-node20:36:140
269049943,0cyclictest510-21awk23:56:150
269049943,0cyclictest3514-21snmpd19:14:470
269049943,0cyclictest32734-21awk00:16:150
269049943,0cyclictest3241-21irqbalance23:30:300
269049943,0cyclictest24554-21sadc22:51:020
269049943,0cyclictest2452-21awk21:16:180
269049943,0cyclictest18381-21awk21:06:170
269049943,0cyclictest18165-21awk22:26:160
269049943,0cyclictest11972-21munin-node20:41:220
269049940,0cyclictest0-21swapper/000:08:150
259940,0migration/29747-21fschecks_time19:26:162
259940,0migration/29681-21idleruntime22:41:172
259940,0migration/24376-21aten_r1power_fr20:11:122
259940,0migration/225559-21kthreadcore20:01:172
259940,0migration/220344-21proc_pri19:06:232
259940,0migration/21980-21kthreadcore20:06:202
259940,0migration/218962-21cpuspeed_turbos20:46:132
259940,0migration/218551-21idleruntime21:26:162
259940,0migration/211991-21aten_r1power_cu20:41:122
259940,0migration/21071-21kthreadcore20:31:182
249940,0watchdog/29242-21ssh22:21:122
249940,0watchdog/22156-21idleruntime21:36:162
249940,0watchdog/210059-21munin-node19:51:242
179940,0migration/19833-21kthreadcore20:36:191
179940,0migration/18337-21unixbench_multi19:21:251
179940,0migration/15326-21munin-node20:11:171
179940,0migration/131600-21timerandwakeup21:31:251
179940,0migration/126540-21kthreadcore23:31:171
179940,0migration/124107-21sh21:07:381
179940,0migration/123933-21aten2.4-expect00:11:121
179940,0migration/123922-21fschecks_time20:01:141
179940,0migration/120496-21kthreadcore21:46:181
179940,0migration/119828-21kthreadcore19:31:191
179940,0migration/117779-21munin-node20:21:141
179940,0migration/116346-21kthreadcore19:06:191
179940,0migration/114746-21ntp_kernel_pll_21:01:191
179940,0migration/112239-21kthreadcore23:01:201
169940,0watchdog/17863-21ssh22:59:471
169940,0watchdog/16559-21runrttasks22:40:561
169940,0watchdog/15487-21unixbench-2d00:16:231
169940,0watchdog/125458-21kthreadcore23:51:191
169940,0watchdog/125093-21diskmemload21:18:201
169940,0watchdog/114782-21python19:26:241
169940,0watchdog/10-21swapper/123:41:071
169940,0watchdog/10-21swapper/123:36:191
169940,0watchdog/10-21swapper/122:16:161
169940,0watchdog/10-21swapper/121:26:161
169940,0watchdog/10-21swapper/119:51:241
149940,0migration/04018-21kthreadcore18:56:190
149940,0migration/032153-21runrttasks20:53:570
149940,0migration/028099-21kthreadcore21:31:190
149940,0migration/025770-21cpuspeed_turbos21:51:130
149940,0migration/024649-21fschecks_count23:51:150
149940,0migration/013735-21kthreadcore23:01:200
29715030,0irq/26-eth0-rx-0-21swapper/320:26:133
29715030,0irq/26-eth0-rx-0-21swapper/320:16:123
29715030,0irq/26-eth0-rx-0-21swapper/320:06:143
29715030,0irq/26-eth0-rx-0-21swapper/319:46:103
29715030,0irq/26-eth0-rx-0-21swapper/319:36:133
29715030,0irq/26-eth0-rx-0-21swapper/319:15:083
269069932,0cyclictest8973-21awk19:01:152
269069932,0cyclictest3514-21snmpd20:21:472
269069932,0cyclictest25466-21cut20:26:182
269069930,0cyclictest0-21swapper/220:39:212
269069930,0cyclictest0-21swapper/219:11:022
269059933,0cyclictest3556-21lldpd22:41:101
269059932,0cyclictest8376-21grep00:01:151
269059932,0cyclictest29718-21cut19:41:161
269059932,0cyclictest27948-21if_err_eth018:51:171
269059932,0cyclictest25697-21awk22:51:151
269059932,0cyclictest2331-21awk21:36:171
269059932,0cyclictest17309-21awk23:26:151
269059930,0cyclictest8727-21diskstats23:21:131
269059930,0cyclictest10867-21munin-node21:21:171
269049933,0cyclictest5085-21kworker/0:222:11:030
269049933,0cyclictest5085-21kworker/0:222:01:050
269049933,0cyclictest5085-21kworker/0:221:41:030
269049933,0cyclictest5085-21kworker/0:221:21:030
269049933,0cyclictest5085-21kworker/0:220:46:050
269049933,0cyclictest5085-21kworker/0:220:16:050
269049933,0cyclictest5085-21kworker/0:200:11:020
269049933,0cyclictest5085-21kworker/0:200:01:040
269049933,0cyclictest10100-21kworker/0:019:46:030
269049933,0cyclictest10100-21kworker/0:019:21:260
269049933,0cyclictest10100-21kworker/0:019:01:040
269049933,0cyclictest10100-21kworker/0:018:51:040
269049932,0cyclictest23305-21awk19:36:160
259930,0migration/221787-21runrttasks19:31:292
169930,0watchdog/10-21swapper/122:11:441
169930,0watchdog/10-21swapper/119:16:041
339920,0migration/315188-21diskstats19:06:153
29715020,0irq/26-eth0-rx-0-21swapper/320:46:223
29715020,0irq/26-eth0-rx-0-21swapper/319:56:133
29715020,0irq/26-eth0-rx-0-21swapper/318:51:133
269059920,0cyclictest0-21swapper/119:11:021
249920,0watchdog/20-21swapper/219:36:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional