You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-17 - 07:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Fri Apr 17, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450350,0irq/25-eth10-21swapper/318:53:403
2549923526,0sleep20-21swapper/218:56:532
2537323322,0sleep00-21swapper/018:55:220
2559423223,0sleep10-21swapper/118:58:001
256919970,0cyclictest0-21swapper/121:08:341
8215060,0irq/24-0000:00:6173-21sa123:48:142
4160,0ktimersoftd/00-21swapper/019:33:400
35160,0ktimersoftd/30-21swapper/300:23:053
339960,0migration/36623-21cpu23:48:243
339960,0migration/36615-21sh22:26:253
339960,0migration/3548-21fschecks_time21:43:283
339960,0migration/330869-21sh22:00:293
339960,0migration/322454-21sh22:56:413
339960,0migration/315712-21sh21:12:373
339960,0migration/313756-21sh22:28:543
339960,0migration/313482-21sh22:48:543
339960,0migration/313482-21sh22:48:543
29725060,0irq/27-eth0-tx-32550-21munin-node19:03:270
29725060,0irq/27-eth0-tx-0-21swapper/223:51:352
29715060,0irq/26-eth0-rx-20406-21yum00:13:413
29715060,0irq/26-eth0-rx-0-21swapper/323:59:043
256929966,0cyclictest0-21swapper/223:18:292
256909966,0cyclictest23811-21diskmemload21:53:380
256909966,0cyclictest0-21swapper/019:13:360
149960,0migration/07167-21sh21:06:410
149960,0migration/06206-21sh23:27:330
149960,0migration/04376-21sh00:03:410
149960,0migration/032039-21sh21:22:330
149960,0migration/013503-21sh23:30:170
8215050,0irq/24-0000:00:12789-21ssh23:08:382
35150,0ktimersoftd/30-21swapper/319:33:403
339950,0migration/3848-21munin-node19:03:283
339950,0migration/3766-21runrttasks21:03:303
339950,0migration/34226-21munin-node20:18:323
339950,0migration/331888-21fschecks_time23:03:283
339950,0migration/330427-21runrttasks22:19:593
339950,0migration/329147-21kthreadcore20:58:323
339950,0migration/326829-21switchtime19:43:373
339950,0migration/326760-21kthreadcore20:33:303
339950,0migration/32176-21kthreadcore21:23:323
339950,0migration/320286-21aten_r1power_fr19:18:273
339950,0migration/319115-21kthreadcore21:53:323
339950,0migration/317969-21kthreadcore20:28:323
339950,0migration/317443-21irqrtprio21:13:293
339950,0migration/315421-21munin-node23:13:283
339950,0migration/314684-21runrttasks22:10:463
339950,0migration/312821-21kthreadcore20:23:333
29725050,0irq/27-eth0-tx-13575-21ntp_kernel_pll_21:48:352
29725050,0irq/27-eth0-tx-10519-21kthreadcore22:28:312
29725050,0irq/27-eth0-tx-0-21swapper/222:23:322
29725050,0irq/27-eth0-tx-0-21swapper/221:41:262
29725050,0irq/27-eth0-tx-0-21swapper/020:58:170
29725050,0irq/27-eth0-tx-0-21swapper/020:50:070
29725050,0irq/27-eth0-tx-0-21swapper/020:46:360
29715050,0irq/26-eth0-rx-660-21iostat_ios22:03:313
29715050,0irq/26-eth0-rx-5996-21kthreadcore19:53:323
29715050,0irq/26-eth0-rx-5399-40yum-updatesd-he22:43:593
29715050,0irq/26-eth0-rx-25938-21kthreadcore22:58:313
29715050,0irq/26-eth0-rx-22658-21cat23:38:143
29715050,0irq/26-eth0-rx-10474-21kthreadcore23:28:333
29715050,0irq/26-eth0-rx-0-21swapper/323:54:233
29715050,0irq/26-eth0-rx-0-21swapper/323:27:263
29715050,0irq/26-eth0-rx-0-21swapper/323:08:333
29715050,0irq/26-eth0-rx-0-21swapper/322:33:163
29715050,0irq/26-eth0-rx-0-21swapper/322:16:263
29715050,0irq/26-eth0-rx-0-21swapper/321:35:053
29715050,0irq/26-eth0-rx-0-21swapper/320:38:333
29715050,0irq/26-eth0-rx-0-21swapper/300:27:393
27150,0ktimersoftd/20-21swapper/223:00:112
27150,0ktimersoftd/20-21swapper/219:33:402
256929955,0cyclictest0-21swapper/200:13:112
256929954,0cyclictest3514-21snmpd23:57:132
256929950,0cyclictest0-21swapper/223:40:142
256929950,0cyclictest0-21swapper/222:54:312
256929950,0cyclictest0-21swapper/222:08:482
256909955,0cyclictest0-21swapper/022:16:580
256909955,0cyclictest0-21swapper/021:27:090
256909955,0cyclictest0-21swapper/021:09:570
256909950,0cyclictest0-21swapper/023:20:580
256909950,0cyclictest0-21swapper/023:11:590
256909950,0cyclictest0-21swapper/022:48:490
256909950,0cyclictest0-21swapper/022:48:490
256909950,0cyclictest0-21swapper/021:51:440
256909950,0cyclictest0-21swapper/000:23:530
256909950,0cyclictest0-21swapper/000:14:530
259950,0migration/26452-21sh22:46:552
259950,0migration/222902-21df_abs23:58:282
259950,0migration/222228-21timerandwakeup20:28:382
249950,0watchdog/228355-21kthreadcore22:18:332
249950,0watchdog/21892-21basename19:28:302
249950,0watchdog/210407-21cat21:08:332
19150,0ktimersoftd/10-21swapper/123:15:101
179950,0migration/19639-21kthreadcore19:33:331
179950,0migration/19292-21kthreadcore22:48:311
179950,0migration/19292-21kthreadcore22:48:311
179950,0migration/18171-21aten_r1power_po21:48:271
179950,0migration/16563-21taskset21:24:041
179950,0migration/14367-21kernelversion20:18:321
179950,0migration/131534-21kthreadcore19:48:321
179950,0migration/129730-21kthreadcore19:23:321
179950,0migration/129055-21munin-node22:58:361
179950,0migration/120616-21fschecks_count19:18:281
179950,0migration/11469-21kthreadcore23:03:321
169950,0watchdog/129589-21sendmail_mailtr22:18:371
149950,0migration/09112-21kthreadcore22:28:300
149950,0migration/08484-21fschecks_time22:08:290
149950,0migration/07654-21hwlatdetect19:08:290
149950,0migration/03797-21kthreadcore22:23:320
149950,0migration/0343-21irqrtprio22:43:320
149950,0migration/032450-21aten_r1power_fr21:43:260
149950,0migration/03234-21kthreadcore22:03:320
149950,0migration/030680-21sh21:39:090
149950,0migration/029103-21switchtime22:58:370
149950,0migration/02782-21kthreadcore23:03:320
149950,0migration/02782-21kthreadcore19:28:320
149950,0migration/027242-21kthreadcore18:58:310
149950,0migration/02412-21kthreadcore23:43:320
149950,0migration/022601-21fschecks_count20:08:280
149950,0migration/021667-21fschecks_time19:43:280
149950,0migration/018324-21kthreadcore21:13:300
149950,0migration/017656-21kthreadcore21:33:310
149950,0migration/016978-21fschecks_time20:28:290
149950,0migration/016859-21kthreadcore23:53:310
149950,0migration/016022-21taskset20:26:220
149950,0migration/015616-21fschecks_time23:13:280
149950,0migration/015593-21cpuspeed_turbos22:53:270
149950,0migration/010967-21kthreadcore00:08:320
149950,0migration/010862-21kthreadcore21:28:320
339940,0migration/329103-21df20:13:263
339940,0migration/326193-21kthreadcore22:38:333
339940,0migration/325092-21hddtemp_smartct21:38:293
339940,0migration/318229-21kthreadcore20:03:313
339940,0migration/316735-21kthreadcore19:13:313
29725040,0irq/27-eth0-tx-32174-21ssh21:03:212
29725040,0irq/27-eth0-tx-32099-21munin-node22:03:312
29725040,0irq/27-eth0-tx-31516-21ssh00:03:302
29725040,0irq/27-eth0-tx-0-21swapper/223:35:152
29725040,0irq/27-eth0-tx-0-21swapper/223:24:192
29725040,0irq/27-eth0-tx-0-21swapper/223:04:012
29725040,0irq/27-eth0-tx-0-21swapper/222:33:322
29725040,0irq/27-eth0-tx-0-21swapper/221:43:222
29725040,0irq/27-eth0-tx-0-21swapper/221:23:232
29725040,0irq/27-eth0-tx-0-21swapper/221:20:352
29725040,0irq/27-eth0-tx-0-21swapper/221:13:342
29725040,0irq/27-eth0-tx-0-21swapper/200:24:112
29725040,0irq/27-eth0-tx-0-21swapper/200:13:152
29725040,0irq/27-eth0-tx-0-21swapper/020:03:290
29725040,0irq/27-eth0-tx-0-21swapper/019:53:350
29725040,0irq/27-eth0-tx-0-21swapper/019:40:430
29725040,0irq/27-eth0-tx-0-21swapper/019:23:300
29715040,0irq/26-eth0-rx-0-21swapper/323:44:183
29715040,0irq/26-eth0-rx-0-21swapper/323:33:233
29715040,0irq/26-eth0-rx-0-21swapper/323:18:263
29715040,0irq/26-eth0-rx-0-21swapper/321:50:043
29715040,0irq/26-eth0-rx-0-21swapper/321:28:313
29715040,0irq/26-eth0-rx-0-21swapper/321:18:323
29715040,0irq/26-eth0-rx-0-21swapper/300:08:313
256929943,0cyclictest3556-21lldpd23:13:432
256929943,0cyclictest3514-21snmpd20:44:422
256929943,0cyclictest3514-21snmpd19:18:422
256929943,0cyclictest3241-21irqbalance20:08:442
256929943,0cyclictest3241-21irqbalance20:03:542
256929943,0cyclictest3241-21irqbalance20:00:042
256929943,0cyclictest3241-21irqbalance19:53:542
256929943,0cyclictest3241-21irqbalance19:43:542
256929943,0cyclictest3241-21irqbalance19:38:442
256929943,0cyclictest3241-21irqbalance19:24:542
256929943,0cyclictest3241-21irqbalance19:13:542
256929943,0cyclictest3241-21irqbalance19:03:242
256929943,0cyclictest3241-21irqbalance18:59:342
256929943,0cyclictest29662-21awk20:13:292
256919944,0cyclictest0-21swapper/121:28:361
256919943,0cyclictest7744-21awk23:28:311
256919943,0cyclictest3556-21lldpd19:07:431
256919943,0cyclictest3514-21snmpd23:35:431
256919943,0cyclictest3514-21snmpd22:15:281
256919943,0cyclictest3514-21snmpd21:59:431
256919943,0cyclictest3514-21snmpd21:35:431
256919943,0cyclictest3514-21snmpd21:20:431
256919943,0cyclictest3514-21snmpd21:14:421
256919943,0cyclictest3514-21snmpd20:58:421
256919943,0cyclictest3514-21snmpd20:57:421
256919943,0cyclictest3514-21snmpd20:04:271
256919943,0cyclictest3514-21snmpd19:40:121
256919943,0cyclictest3241-21irqbalance21:43:331
256919943,0cyclictest3241-21irqbalance21:04:341
256919943,0cyclictest26880-21awk18:58:301
256919943,0cyclictest24464-21awk22:38:311
256919940,0cyclictest0-21swapper/123:24:291
256919940,0cyclictest0-21swapper/122:04:041
256909943,0cyclictest28648-21awk19:48:300
256909943,0cyclictest23721-21awk23:38:320
256909943,0cyclictest23261-21awk00:18:310
256909943,0cyclictest15717-21awk23:33:290
256909943,0cyclictest1116-21kworker/0:222:37:000
259940,0migration/28232-21sh21:28:172
259940,0migration/228699-21munin-node20:33:342
259940,0migration/224451-21kthreadcore00:18:322
259940,0migration/223956-21latency_hist20:58:152
259940,0migration/221611-21latency21:33:322
259940,0migration/213626-21sh22:49:152
259940,0migration/213626-21sh22:49:152
259940,0migration/212625-21switchtime19:08:372
249940,0watchdog/227718-21kthreadcore22:38:332
249940,0watchdog/224879-21hwlatdetect21:58:292
249940,0watchdog/217939-21fschecks_time20:53:292
249940,0watchdog/217166-21kthreadcore22:13:332
249940,0watchdog/215440-21python20:23:382
249940,0watchdog/20-21swapper/223:28:332
249940,0watchdog/20-21swapper/221:53:292
249940,0watchdog/20-21swapper/220:48:262
249940,0watchdog/20-21swapper/220:18:302
249940,0watchdog/20-21swapper/219:48:382
179940,0migration/1871-21kthreadcore20:38:331
179940,0migration/18399-21kthreadcore19:08:321
179940,0migration/18238-21kthreadcore00:08:311
179940,0migration/17033-21fschecks_time23:48:251
179940,0migration/1474-21irqcore22:23:311
179940,0migration/13767-21kthreadcore19:28:321
179940,0migration/131403-21latency_hist22:43:151
179940,0migration/129187-21unixbench_singl23:18:361
179940,0migration/126005-21kthreadcore23:38:341
179940,0migration/125364-21kthreadcore19:43:321
179940,0migration/124746-21fschecks_count21:38:291
179940,0migration/123311-21irqrtprio20:08:311
179940,0migration/120949-21kthreadcore20:28:331
179940,0migration/116530-21irqrtprio22:53:311
179940,0migration/110001-21unixbench_singl20:43:381
169940,0watchdog/17647-21awk22:28:251
169940,0watchdog/13478-21nfs4_client00:23:331
169940,0watchdog/128940-21ssh23:59:251
169940,0watchdog/124909-21kthreadcore20:33:301
169940,0watchdog/122018-21ssh22:34:451
169940,0watchdog/121844-21munin-node21:53:371
169940,0watchdog/114778-21fschecks_count00:13:291
169940,0watchdog/114446-21sensors_fan19:58:341
169940,0watchdog/110552-21smartctl20:23:301
169940,0watchdog/10-21swapper/123:53:331
169940,0watchdog/10-21swapper/123:09:011
169940,0watchdog/10-21swapper/120:48:261
169940,0watchdog/10-21swapper/100:03:331
149940,0migration/0803-21kthreadcore20:38:330
149940,0migration/04756-21kthreadcore20:18:320
149940,0migration/023528-21runrttasks20:55:130
149940,0migration/022685-21runrttasks23:58:270
339930,0migration/319372-21kthreadcore19:38:333
339930,0migration/314233-21kthreadcore20:48:293
339930,0migration/313372-21kthreadcore19:58:303
29715030,0irq/26-eth0-rx-0-21swapper/320:43:263
29715030,0irq/26-eth0-rx-0-21swapper/319:32:253
29715030,0irq/26-eth0-rx-0-21swapper/319:27:373
29715030,0irq/26-eth0-rx-0-21swapper/319:08:263
29715030,0irq/26-eth0-rx-0-21swapper/300:03:283
256929932,0cyclictest30580-21awk20:38:302
256919932,0cyclictest3514-21snmpd20:13:421
256919932,0cyclictest123542tr22:08:331
256909933,0cyclictest4708-21kworker/0:123:48:160
256909933,0cyclictest1116-21kworker/0:222:38:160
256909933,0cyclictest1116-21kworker/0:222:18:300
256909933,0cyclictest1116-21kworker/0:220:33:450
256909933,0cyclictest1116-21kworker/0:220:13:250
256909933,0cyclictest1116-21kworker/0:219:58:190
256909932,0cyclictest24487-21forks21:58:280
256909930,0cyclictest20197-21munin-node19:18:290
169930,0watchdog/125468-21kthreadcore00:18:331
169930,0watchdog/10-21swapper/123:45:171
169930,0watchdog/10-21swapper/119:53:261
169930,0watchdog/10-21swapper/119:13:261
29715020,0irq/26-eth0-rx-0-21swapper/320:53:273
29715020,0irq/26-eth0-rx-0-21swapper/320:08:233
29715020,0irq/26-eth0-rx-0-21swapper/319:48:343
29715020,0irq/26-eth0-rx-0-21swapper/318:58:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional