You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 05:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Thu Sep 03, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450750,0irq/25-eth10-21swapper/318:40:163
630223927,0sleep20-21swapper/218:41:582
633823423,0sleep00-21swapper/018:42:200
581623223,0sleep10-21swapper/118:40:251
66459965,0cyclictest8044-21cut18:45:180
66459960,0cyclictest0-21swapper/022:19:510
339960,0migration/323558-21sh23:58:033
29725060,0irq/27-eth0-tx-28355-21munin-node21:40:162
29725060,0irq/27-eth0-tx-1616-21munin-node23:05:172
29715060,0irq/26-eth0-rx-8985-21port_sshpriv22:05:213
29715060,0irq/26-eth0-rx-5996-21iostat_ios21:05:163
29715060,0irq/26-eth0-rx-31303-21cut22:40:183
29715060,0irq/26-eth0-rx-2825-21ssh21:42:473
29715060,0irq/26-eth0-rx-27148-21munin-node20:55:273
27160,0ktimersoftd/20-21swapper/223:20:172
149960,0migration/019725-21sh21:12:020
8215050,0irq/24-0000:00:2395-21latency_hist22:25:012
8215050,0irq/24-0000:00:17871-21perf22:55:012
66469955,0cyclictest0-21swapper/122:42:071
66469955,0cyclictest0-21swapper/120:54:171
66469954,0cyclictest2941-21awk19:30:171
66469954,0cyclictest24964-21awk20:35:171
66469950,0cyclictest0-21swapper/122:23:501
66469950,0cyclictest0-21swapper/122:09:581
66469950,0cyclictest0-21swapper/100:07:251
66459955,0cyclictest0-21swapper/023:42:560
66459955,0cyclictest0-21swapper/023:36:180
66459955,0cyclictest0-21swapper/022:30:240
66459955,0cyclictest0-21swapper/021:04:010
66459955,0cyclictest0-21swapper/020:51:140
66459950,0cyclictest0-21swapper/023:47:210
66459950,0cyclictest0-21swapper/021:21:310
66459950,0cyclictest0-21swapper/021:15:410
4150,0ktimersoftd/00-21swapper/021:53:400
339950,0migration/37080-21munin-node21:45:233
339950,0migration/36125-21kthreadcore19:05:193
339950,0migration/35795-21kthreadcore19:55:183
339950,0migration/34506-21kthreadcore23:45:193
339950,0migration/33596-21kthreadcore23:25:183
339950,0migration/33539-21idleruntime22:25:153
339950,0migration/33346-21kthreadcore20:40:193
339950,0migration/330934-21kthreadcore19:25:193
339950,0migration/329001-21aten_r1power_cu21:20:123
339950,0migration/326153-21taskset23:00:123
339950,0migration/324420-21latency_hist00:00:013
339950,0migration/323693-21taskset20:34:323
339950,0migration/323185-21kthreadcore22:35:173
339950,0migration/321738-21kthreadcore22:15:193
339950,0migration/321144-21aten_r1power_vo21:15:133
339950,0migration/319836-21aten_r1power_en21:55:123
339950,0migration/317092-21kthreadcore20:50:213
339950,0migration/316139-21kthreadcore21:50:163
339950,0migration/314200-21unixbench_singl00:10:253
339950,0migration/313903-21idleruntime21:10:163
339950,0migration/312527-21sh18:45:243
339950,0migration/310826-21kthreadcore19:10:193
29725050,0irq/27-eth0-tx-950-21proc_pri22:00:212
29725050,0irq/27-eth0-tx-6729-21kthreadcore21:45:232
29725050,0irq/27-eth0-tx-32410-21munin-node00:05:242
29725050,0irq/27-eth0-tx-26363-21ssh21:15:202
29725050,0irq/27-eth0-tx-24551-21ssh22:56:102
29725050,0irq/27-eth0-tx-204642chrt21:14:172
29725050,0irq/27-eth0-tx-15603-21wc23:10:242
29725050,0irq/27-eth0-tx-12928-21munin-node20:50:162
29725050,0irq/27-eth0-tx-11231-21ssh20:45:440
29725050,0irq/27-eth0-tx-1076-21munin-node23:25:232
29725050,0irq/27-eth0-tx-0-21swapper/222:10:202
29725050,0irq/27-eth0-tx-0-21swapper/221:51:532
29725050,0irq/27-eth0-tx-0-21swapper/221:34:152
29725050,0irq/27-eth0-tx-0-21swapper/020:00:100
29715050,0irq/26-eth0-rx-26212-21python21:35:233
29715050,0irq/26-eth0-rx-2494-21sendmail_mailst21:00:233
29715050,0irq/26-eth0-rx-18347-21kthreadcore23:35:163
29715050,0irq/26-eth0-rx-175182sleep323:15:033
29715050,0irq/26-eth0-rx-17030-21cut19:15:183
29715050,0irq/26-eth0-rx-14369-21kthreadcore22:30:183
29715050,0irq/26-eth0-rx-12945-21kthreadcore22:50:163
29715050,0irq/26-eth0-rx-0-21swapper/323:40:223
29715050,0irq/26-eth0-rx-0-21swapper/323:22:013
29715050,0irq/26-eth0-rx-0-21swapper/323:10:173
29715050,0irq/26-eth0-rx-0-21swapper/322:55:483
29715050,0irq/26-eth0-rx-0-21swapper/322:47:043
29715050,0irq/26-eth0-rx-0-21swapper/322:21:193
29715050,0irq/26-eth0-rx-0-21swapper/322:13:253
29715050,0irq/26-eth0-rx-0-21swapper/321:34:193
29715050,0irq/26-eth0-rx-0-21swapper/319:50:183
259950,0migration/28745-21aten_r1power_po23:50:132
259950,0migration/27051-21kthreadcore22:45:232
259950,0migration/227623-21irqcore22:40:162
259950,0migration/227470-21runrttasks21:38:082
259950,0migration/225398-21sh22:37:142
259950,0migration/223089-21munin-node23:15:192
259950,0migration/217153-21aten_r1power_vo23:35:102
259950,0migration/211393-21fschecks_time20:25:152
19150,0ktimersoftd/10-21swapper/121:13:591
179950,0migration/19931-21kthreadcore00:10:191
179950,0migration/17640-21kthreadcore20:45:181
179950,0migration/17183-21taskset23:46:301
179950,0migration/128805-21latency_hist21:20:021
179950,0migration/124912-21kthreadcore20:10:191
179950,0migration/124002-21sh23:59:231
179950,0migration/119030-21latency_hist22:15:011
179950,0migration/116494-21taskset23:12:351
169950,0watchdog/14272-21ssh21:25:001
149950,0migration/09637-21kthreadcore21:05:180
149950,0migration/06267-21taskset00:05:300
149950,0migration/05051-21kthreadcore19:30:190
149950,0migration/024125-21timerwakeupswit22:55:260
149950,0migration/023158-21kthreadcore20:55:200
149950,0migration/021106-21latency_hist19:20:020
149950,0migration/017856-21kthreadcore20:05:170
149950,0migration/01755-21fschecks_time19:05:150
149950,0migration/014273-21munin-node18:50:150
8215040,0irq/24-0000:00:29659-21cat20:15:022
8215040,0irq/24-0000:00:0-21swapper/220:14:572
66479944,0cyclictest0-21swapper/219:40:212
66479943,0cyclictest5446-21awk21:25:212
66479943,0cyclictest3514-21snmpd20:33:382
66479943,0cyclictest3514-21snmpd19:30:532
66479943,0cyclictest22029-21awk20:55:192
66479943,0cyclictest11648-21awk22:30:162
66469943,0cyclictest3556-21lldpd22:45:191
66469943,0cyclictest3514-21snmpd22:25:091
66469943,0cyclictest3514-21snmpd22:15:241
66469943,0cyclictest3514-21snmpd21:47:391
66469943,0cyclictest3514-21snmpd20:55:231
66469943,0cyclictest3514-21snmpd19:45:231
66469943,0cyclictest3241-21irqbalance23:15:491
66469943,0cyclictest3241-21irqbalance21:40:301
66469943,0cyclictest26412-21awk23:20:151
66469943,0cyclictest2567-21awk23:05:161
66469943,0cyclictest14361-21awk18:50:161
66469943,0cyclictest13501-21awk21:30:161
66469943,0cyclictest11001-21awk22:50:131
66459944,0cyclictest0-21swapper/022:24:340
66459944,0cyclictest0-21swapper/022:08:110
66459944,0cyclictest0-21swapper/022:02:210
66459944,0cyclictest0-21swapper/021:27:210
66459943,0cyclictest9828-21awk19:35:160
66459943,0cyclictest3936-21awk19:55:160
66459943,0cyclictest3556-21lldpd23:16:190
66459943,0cyclictest3556-21lldpd20:30:190
66459943,0cyclictest3514-21snmpd19:10:530
66459943,0cyclictest3241-21irqbalance23:13:590
66459943,0cyclictest3241-21irqbalance23:05:390
66459943,0cyclictest3241-21irqbalance22:41:090
66459943,0cyclictest3241-21irqbalance21:32:100
66459943,0cyclictest3241-21irqbalance20:10:100
66459943,0cyclictest3241-21irqbalance19:50:100
66459943,0cyclictest31529-21awk20:40:160
66459943,0cyclictest26960-21awk23:00:160
66459943,0cyclictest2046-21awk23:25:160
66459943,0cyclictest19646-21awk22:35:150
66459943,0cyclictest18936-21sadc22:15:010
66459943,0cyclictest17419-21awk23:55:140
66459941,0cyclictest0-21swapper/022:30:010
66459940,0cyclictest0-21swapper/020:35:150
339940,0migration/35786-21kthreadcore20:20:173
339940,0migration/33651-21kthreadcore19:30:193
339940,0migration/328253-21kthreadcore20:35:193
339940,0migration/321511-21cpuspeed_turbos19:20:163
339940,0migration/314977-21kthreadcore20:25:183
339940,0migration/313480-21latency_hist18:50:023
29725040,0irq/27-eth0-tx-19188-21ssh22:15:072
29725040,0irq/27-eth0-tx-0-21swapper/223:55:062
29725040,0irq/27-eth0-tx-0-21swapper/223:46:022
29725040,0irq/27-eth0-tx-0-21swapper/223:00:202
29725040,0irq/27-eth0-tx-0-21swapper/221:20:312
29725040,0irq/27-eth0-tx-0-21swapper/220:47:022
29725040,0irq/27-eth0-tx-0-21swapper/200:10:022
29725040,0irq/27-eth0-tx-0-21swapper/200:00:532
29725040,0irq/27-eth0-tx-0-21swapper/020:18:190
29725040,0irq/27-eth0-tx-0-21swapper/019:28:300
29725040,0irq/27-eth0-tx-0-21swapper/019:18:280
29715040,0irq/26-eth0-rx-0-21swapper/323:50:133
29715040,0irq/26-eth0-rx-0-21swapper/323:30:123
29715040,0irq/26-eth0-rx-0-21swapper/323:07:523
29715040,0irq/26-eth0-rx-0-21swapper/322:00:173
29715040,0irq/26-eth0-rx-0-21swapper/321:27:523
29715040,0irq/26-eth0-rx-0-21swapper/320:45:163
29715040,0irq/26-eth0-rx-0-21swapper/320:15:063
29715040,0irq/26-eth0-rx-0-21swapper/319:35:183
29715040,0irq/26-eth0-rx-0-21swapper/300:07:073
259940,0migration/29263-21kthreadcore18:45:192
259940,0migration/24824-21latency_hist21:05:022
259940,0migration/24241-21munin-node20:20:132
259940,0migration/23834-21pmu-power20:40:222
259940,0migration/23346-21cpuspeed_turbos19:55:132
259940,0migration/230071-21if_err_eth1.321:00:172
259940,0migration/229139-21kthreadcore19:00:182
259940,0migration/228213-21runrttasks19:46:162
259940,0migration/227481-21cpuspeed_turbos22:20:132
259940,0migration/227069-21kthreadcore23:40:212
259940,0migration/22624-21kthreadcore19:05:182
259940,0migration/224988-21munin-node20:35:182
259940,0migration/221503-21kthreadcore21:55:172
259940,0migration/220294-21timerandwakeup19:15:242
259940,0migration/218256-21kthreadcore20:05:172
259940,0migration/211523-21kthreadcore23:30:182
249940,0watchdog/221449-21tr19:20:162
249940,0watchdog/210198-21diskstats20:00:122
249940,0watchdog/20-21swapper/222:05:032
179940,0migration/19696-21kthreadcore19:10:181
179940,0migration/18847-21runrttasks19:35:111
179940,0migration/17668-21kthreadcore20:20:181
179940,0migration/132485-21kthreadcore22:00:181
179940,0migration/130942-21kthreadcore19:00:191
179940,0migration/128742-21kthreadcore23:40:221
179940,0migration/125875-21kthreadcore00:00:191
179940,0migration/12447-21taskset19:51:111
179940,0migration/121995-21kthreadcore21:55:171
179940,0migration/121034-21kthreadcore22:55:201
179940,0migration/120220-21aten_r1power_en18:55:131
179940,0migration/118144-21irqcore23:35:151
179940,0migration/114898-21kthreadcore20:00:171
169940,0watchdog/1723-21cat19:25:201
169940,0watchdog/15164-21tune2fs21:25:201
169940,0watchdog/13250-21sh21:01:201
169940,0watchdog/130541-21cut23:00:191
169940,0watchdog/121283-21idleruntime21:35:161
169940,0watchdog/118623-21ssh22:35:071
169940,0watchdog/116480-21python22:30:231
169940,0watchdog/113493-21kthreadcore21:50:151
169940,0watchdog/10-21swapper/123:50:191
169940,0watchdog/10-21swapper/123:31:551
169940,0watchdog/10-21swapper/121:05:441
169940,0watchdog/10-21swapper/119:20:161
149940,0migration/04616-21fschecks_time21:45:190
149940,0migration/032003-21kthreadcore21:40:170
149940,0migration/030942-21mdstat23:20:180
149940,0migration/022105-21latency_hist19:45:020
149940,0migration/019133-21kthreadcore19:40:230
149940,0migration/013301-21kthreadcore00:10:200
8215030,0irq/24-0000:00:0-21swapper/218:55:182
66479932,0cyclictest14344-21awk18:50:162
66479932,0cyclictest11557-21cut19:35:182
66469933,0cyclictest18304-21awk20:30:151
66469932,0cyclictest9561-21crond20:00:021
66469932,0cyclictest31632-21awk20:40:171
66469932,0cyclictest1930-21awk19:05:161
66469932,0cyclictest11630-21awk20:25:161
66469931,0cyclictest17533-21irqcore20:05:171
66469930,0cyclictest16224-21perl19:40:191
66459932,0cyclictest3241-21irqbalance22:45:090
66459932,0cyclictest21458-21awk21:35:170
66459932,0cyclictest14209-21grep20:25:180
66459932,0cyclictest10338-21ssh23:50:180
66459930,0cyclictest20558-21diskstats18:55:150
66459930,0cyclictest20109-21df21:55:130
66459930,0cyclictest0-21swapper/022:50:160
29725030,0irq/27-eth0-tx-26963-21telnet19:00:130
29725030,0irq/27-eth0-tx-0-21swapper/020:22:250
29715030,0irq/26-eth0-rx-0-21swapper/320:10:133
29715030,0irq/26-eth0-rx-0-21swapper/320:05:163
29715030,0irq/26-eth0-rx-0-21swapper/319:45:163
29715030,0irq/26-eth0-rx-0-21swapper/319:40:373
29715030,0irq/26-eth0-rx-0-21swapper/319:00:123
29715030,0irq/26-eth0-rx-0-21swapper/318:56:473
259930,0migration/231323-21kthreadcore19:25:192
249930,0watchdog/20-21swapper/219:51:322
249930,0watchdog/20-21swapper/219:10:162
179930,0migration/113188-21runrttasks18:49:081
169930,0watchdog/10-21swapper/123:25:111
149930,0migration/030980-21runrttasks00:01:330
66469920,0cyclictest0-21swapper/120:15:081
66459920,0cyclictest0-21swapper/023:30:010
29715020,0irq/26-eth0-rx-0-21swapper/320:00:033
169920,0watchdog/10-21swapper/119:15:041
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional