You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 20:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Jul 26, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450630,0irq/25-eth10-21swapper/306:45:053
475724039,0sleep10-21swapper/106:45:371
464623531,0sleep20-21swapper/206:44:222
469223423,0sleep00-21swapper/006:44:520
50929976,0cyclictest15707-21munin-node11:38:561
50929974,0cyclictest30350-21proc_pri10:44:011
50939960,0cyclictest0-21swapper/209:40:302
50929963,0cyclictest912-21df_inode07:33:561
50929963,0cyclictest8564-21cat12:13:591
50929963,0cyclictest8421-21sort08:24:031
50929963,0cyclictest790-21perl10:48:561
50929963,0cyclictest32084-21ntpdc09:44:011
50929963,0cyclictest28332-21ntp_states11:44:011
50929963,0cyclictest27053-21sed09:23:421
50929963,0cyclictest25949-21memory07:49:001
50929963,0cyclictest24170-21hwlatdetect11:23:551
50929963,0cyclictest19064-21diskstats09:38:551
50929963,0cyclictest17287-21timerwakeupswit08:54:051
50929963,0cyclictest15816-21ssh10:58:391
50919965,0cyclictest3241-21irqbalance10:27:200
50919965,0cyclictest28307-21ps07:53:580
339960,0migration/37061-21sh11:13:133
339960,0migration/332743-21sh09:44:163
339960,0migration/326761-21sh09:23:073
339960,0migration/318841-21sh09:18:033
339960,0migration/315733-21kthreadcore07:44:003
339960,0migration/315025-21sh11:18:183
339960,0migration/312362-21munin-node11:33:583
339960,0migration/310464-21idleruntime-cro09:33:423
29715060,0irq/26-eth0-rx-19174-21sh08:58:293
29715060,0irq/26-eth0-rx-16521-21diskstats10:58:543
29715060,0irq/26-eth0-rx-0-21swapper/309:36:543
149960,0migration/09367-21sh09:52:230
149960,0migration/022825-21fschecks_time12:03:550
149960,0migration/019603-21cpuspeed_turbos09:18:550
149960,0migration/010653-21latency_hist09:33:420
8215050,0irq/24-0000:00:3078-21sa109:08:422
50939955,0cyclictest0-21swapper/211:54:502
50939955,0cyclictest0-21swapper/210:51:462
50939955,0cyclictest0-21swapper/210:46:052
50939955,0cyclictest0-21swapper/210:32:042
50939955,0cyclictest0-21swapper/209:58:102
50939955,0cyclictest0-21swapper/209:26:282
50939950,0cyclictest0-21swapper/211:58:462
50939950,0cyclictest0-21swapper/211:23:462
50939950,0cyclictest0-21swapper/209:00:092
50929954,0cyclictest30785-21aten2.4-expect11:48:521
50929953,0cyclictest9320-21sort10:13:421
50929953,0cyclictest9155-21latency_hist08:28:421
50929953,0cyclictest9007-21head10:33:551
50929953,0cyclictest8334-21aten2.4-expect08:03:541
50929953,0cyclictest776-21ssh10:28:521
50929953,0cyclictest7492-21ssh11:13:501
50929953,0cyclictest7424-21aten2.4-expect07:38:541
50929953,0cyclictest6876-21ssh11:33:461
50929953,0cyclictest6726-21munin-node11:53:561
50929953,0cyclictest6206-21sed07:13:421
50929953,0cyclictest5628-21munin-node06:48:541
50929953,0cyclictest3879-21df08:48:581
50929953,0cyclictest3764-21sed09:08:561
50929953,0cyclictest32608-21perl07:08:531
50929953,0cyclictest31859-21ssh11:08:441
50929953,0cyclictest31294-21ssh11:28:501
50929953,0cyclictest3055-21df09:28:541
50929953,0cyclictest30128-21cut12:08:511
50929953,0cyclictest29261-21telnet08:43:511
50929953,0cyclictest28293-21aten2.4-expect08:18:531
50929953,0cyclictest27692-21cut09:03:541
50929953,0cyclictest27347-21cut09:23:531
50929953,0cyclictest27326-21aten2.4-expect07:53:531
50929953,0cyclictest26259-21date07:28:421
50929953,0cyclictest25948-21rm10:03:561
50929953,0cyclictest25277-21sed07:03:421
50929953,0cyclictest25168-21ls10:23:421
50929953,0cyclictest24040-21aten2.4-expect11:03:521
50929953,0cyclictest24040-21aten2.4-expect11:03:521
50929953,0cyclictest23542-21sh08:38:581
50929953,0cyclictest22124-21sh12:03:491
50929953,0cyclictest2171-21aten_r1power_po09:48:521
50929953,0cyclictest21657-21aten_r1power_fr08:13:541
50929953,0cyclictest19610-21date07:23:421
50929953,0cyclictest19594-21head08:58:521
50929953,0cyclictest18639-21chrt06:58:491
50929953,0cyclictest18040-21ssh09:58:521
50929953,0cyclictest17264-21date10:18:421
50929953,0cyclictest1687-21cat10:08:541
50929953,0cyclictest16766-21aten2.4-expect10:38:531
50929953,0cyclictest16453-21df_abs10:58:541
50929953,0cyclictest1642-21head07:58:541
50929953,0cyclictest15856-21latency_hist08:33:421
50929953,0cyclictest15511-21aten_r1power_fr11:18:541
50929953,0cyclictest15353-21diskstats08:08:571
50929953,0cyclictest14826-21perl11:58:541
50929953,0cyclictest14162-21cpu07:43:551
50929953,0cyclictest13116-21munin-node07:18:541
50929953,0cyclictest12100-21awk06:53:541
50929953,0cyclictest11363-21ssh09:13:471
50929953,0cyclictest10959-21sort09:33:541
50929953,0cyclictest10142-21aten2.4-expect09:53:521
50919955,0cyclictest0-21swapper/008:34:020
50919950,0cyclictest3256-21diskmemload09:58:130
339950,0migration/39579-21aten_r1power_po10:13:543
339950,0migration/37990-21kthreadcore09:09:013
339950,0migration/36435-21kthreadcore09:48:583
339950,0migration/35656-21kthreadcore08:23:583
339950,0migration/35309-21aten_r1power_cu06:48:533
339950,0migration/34736-21irqrtprio08:49:023
339950,0migration/33630-21kthreadcore07:34:013
339950,0migration/331869-21kthreadcore08:18:593
339950,0migration/331839-21munin-node07:29:023
339950,0migration/329105-21kthreadcore09:23:593
339950,0migration/328679-21irqcore09:03:593
339950,0migration/32353-21kthreadcore12:08:583
339950,0migration/323514-21if_eth1.308:38:573
339950,0migration/318857-21kthreadcore10:38:593
339950,0migration/318611-21munin-node07:19:033
339950,0migration/318289-21kthreadcore11:18:593
339950,0migration/316599-21kthreadcore11:58:583
29725050,0irq/27-eth0-tx-0-21swapper/211:08:572
29725050,0irq/27-eth0-tx-0-21swapper/210:16:482
29725050,0irq/27-eth0-tx-0-21swapper/209:59:212
29715050,0irq/26-eth0-rx-7247-21ssh10:29:313
29715050,0irq/26-eth0-rx-31877-21ssh10:47:193
29715050,0irq/26-eth0-rx-22878-21kthreadcore09:39:003
29715050,0irq/26-eth0-rx-0-21swapper/312:15:203
29715050,0irq/26-eth0-rx-0-21swapper/312:03:483
29715050,0irq/26-eth0-rx-0-21swapper/311:55:313
29715050,0irq/26-eth0-rx-0-21swapper/311:48:593
29715050,0irq/26-eth0-rx-0-21swapper/311:39:073
29715050,0irq/26-eth0-rx-0-21swapper/311:30:063
29715050,0irq/26-eth0-rx-0-21swapper/311:28:293
29715050,0irq/26-eth0-rx-0-21swapper/311:03:553
29715050,0irq/26-eth0-rx-0-21swapper/311:03:553
29715050,0irq/26-eth0-rx-0-21swapper/310:54:023
29715050,0irq/26-eth0-rx-0-21swapper/310:26:433
29715050,0irq/26-eth0-rx-0-21swapper/310:18:583
29715050,0irq/26-eth0-rx-0-21swapper/309:59:283
29715050,0irq/26-eth0-rx-0-21swapper/309:54:043
29715050,0irq/26-eth0-rx-0-21swapper/307:58:533
27150,0ktimersoftd/20-21swapper/209:32:182
259950,0migration/230518-21latency_hist11:48:402
249950,0watchdog/27979-21tr12:13:592
149950,0migration/07028-21gltestperf07:13:560
149950,0migration/0576-21kthreadcore08:18:590
149950,0migration/04747-21kernelversion09:09:000
149950,0migration/032140-21kthreadcore12:08:570
149950,0migration/027101-21kthreadcore10:43:580
149950,0migration/026487-21fschecks_count10:04:000
149950,0migration/025693-21kthreadcore08:38:590
149950,0migration/023518-21kthreadcore07:48:590
149950,0migration/02329-21kthreadcore10:28:580
149950,0migration/021975-21munin-node08:13:550
149950,0migration/019988-21kthreadcore11:38:590
149950,0migration/01933-21kthreadcore07:34:000
149950,0migration/019110-21kthreadcore07:44:010
149950,0migration/019093-21fschecks_count09:38:550
149950,0migration/018400-21kthreadcore11:18:590
149950,0migration/015684-21kthreadcore08:54:000
149950,0migration/015343-21taskset10:35:170
149950,0migration/013603-21unixbench_singl11:14:070
149950,0migration/011272-21kthreadcore08:04:000
149950,0migration/01014-21sh09:46:210
8215040,0irq/24-0000:00:16471-21latency_hist10:38:422
50939943,0cyclictest3556-21lldpd11:33:492
50939943,0cyclictest3556-21lldpd08:08:192
50939943,0cyclictest3556-21lldpd08:00:192
50939943,0cyclictest3556-21lldpd06:48:492
50939943,0cyclictest3514-21snmpd06:54:372
50939943,0cyclictest3241-21irqbalance09:44:502
50939943,0cyclictest3241-21irqbalance09:19:502
50939943,0cyclictest3241-21irqbalance09:08:502
50939943,0cyclictest3241-21irqbalance07:33:502
50939943,0cyclictest3241-21irqbalance07:28:502
50939943,0cyclictest3241-21irqbalance07:25:102
50939943,0cyclictest3241-21irqbalance07:04:102
50939943,0cyclictest3241-21irqbalance06:58:512
50919944,0cyclictest25079-21kworker/0:007:07:090
50919943,0cyclictest8213-21awk07:38:570
50919943,0cyclictest4539-21awk08:49:010
50919943,0cyclictest3556-21lldpd09:30:190
50919943,0cyclictest3556-21lldpd08:11:190
50919943,0cyclictest3556-21lldpd08:01:190
50919943,0cyclictest3556-21lldpd07:10:190
50919943,0cyclictest3514-21snmpd11:44:370
50919943,0cyclictest3241-21irqbalance12:02:590
50919943,0cyclictest3241-21irqbalance11:00:500
50919943,0cyclictest3241-21irqbalance10:54:000
50919943,0cyclictest3241-21irqbalance10:50:100
50919943,0cyclictest30140-21awk08:43:550
50919943,0cyclictest28127-21awk09:23:570
50919943,0cyclictest27259-21awk07:28:570
50919943,0cyclictest2405-21awk10:08:570
50919943,0cyclictest14551-21sadc11:38:410
50919943,0cyclictest13804-21awk07:18:570
50919943,0cyclictest12809-21awk06:53:560
50919943,0cyclictest12281-21awk09:13:570
50919943,0cyclictest10372-21awk10:13:570
339940,0migration/332673-21kthreadcore08:43:573
339940,0migration/331261-21kthreadcore10:04:053
339940,0migration/321004-21kthreadcore07:23:573
339940,0migration/32046-21kthreadcore07:08:573
339940,0migration/320353-21kthreadcore06:58:593
339940,0migration/317321-21kthreadcore08:09:013
339940,0migration/313750-21kthreadcore10:34:013
29725040,0irq/27-eth0-tx-3256-21diskmemload11:28:432
29725040,0irq/27-eth0-tx-20648-21munin-node07:49:042
29725040,0irq/27-eth0-tx-17289-21ssh10:18:432
29725040,0irq/27-eth0-tx-0-21swapper/211:49:342
29725040,0irq/27-eth0-tx-0-21swapper/211:38:562
29725040,0irq/27-eth0-tx-0-21swapper/211:14:112
29725040,0irq/27-eth0-tx-0-21swapper/211:05:172
29725040,0irq/27-eth0-tx-0-21swapper/211:05:172
29725040,0irq/27-eth0-tx-0-21swapper/210:59:102
29725040,0irq/27-eth0-tx-0-21swapper/210:24:442
29725040,0irq/27-eth0-tx-0-21swapper/210:08:422
29725040,0irq/27-eth0-tx-0-21swapper/210:03:522
29725040,0irq/27-eth0-tx-0-21swapper/209:48:502
29725040,0irq/27-eth0-tx-0-21swapper/209:34:352
29725040,0irq/27-eth0-tx-0-21swapper/209:13:552
29715040,0irq/26-eth0-rx-0-21swapper/311:45:103
29715040,0irq/26-eth0-rx-0-21swapper/310:48:553
29715040,0irq/26-eth0-rx-0-21swapper/310:13:073
29715040,0irq/26-eth0-rx-0-21swapper/308:58:423
29715040,0irq/26-eth0-rx-0-21swapper/308:13:533
259940,0migration/2777-21kthreadcore08:18:592
259940,0migration/25403-21kthreadcore08:49:022
259940,0migration/232409-21kthreadcore12:08:572
259940,0migration/215311-21runrttasks08:29:302
259940,0migration/214368-21ntp_kernel_err10:34:032
259940,0migration/213752-21idleruntime07:18:572
259940,0migration/211328-21runrttasks08:53:482
259940,0migration/211171-21kthreadcore07:14:002
259940,0migration/210466-21kthreadcore10:53:592
249940,0watchdog/25617-21yum07:09:042
249940,0watchdog/23527-21if_eth1.308:23:562
249940,0watchdog/226397-21cut08:14:002
249940,0watchdog/224082-21cat12:03:592
249940,0watchdog/222191-21ksmtuned08:37:282
249940,0watchdog/216972-21kthreadcore07:44:002
249940,0watchdog/20-21swapper/211:18:592
249940,0watchdog/20-21swapper/208:43:562
149940,0migration/030157-21kthreadcore09:04:000
149940,0migration/025832-21kthreadcore11:23:580
149940,0migration/021052-21kthreadcore07:23:570
50939933,0cyclictest3556-21lldpd08:38:492
50939932,0cyclictest14956-21munin-node08:08:552
50939932,0cyclictest0-21swapper/207:53:482
50919933,0cyclictest25459-21kworker/0:211:08:470
50919933,0cyclictest25079-21kworker/0:009:58:530
50919933,0cyclictest25079-21kworker/0:008:59:010
50919933,0cyclictest25079-21kworker/0:008:28:450
50919933,0cyclictest25079-21kworker/0:006:58:570
50919933,0cyclictest25079-21kworker/0:006:48:480
50919933,0cyclictest24158-21kworker/0:111:53:480
50919933,0cyclictest0-21swapper/011:05:040
50919933,0cyclictest0-21swapper/011:05:040
50919932,0cyclictest4134-21sensors11:49:030
50919932,0cyclictest3556-21lldpd08:23:490
50919932,0cyclictest3514-21snmpd12:13:520
50919932,0cyclictest32160-21awk11:28:570
50919932,0cyclictest17670-21awk10:38:570
50919930,0cyclictest18016-21perl10:18:560
29725030,0irq/27-eth0-tx-0-21swapper/207:38:592
29715030,0irq/26-eth0-rx-0-21swapper/308:33:573
29715030,0irq/26-eth0-rx-0-21swapper/308:28:533
29715030,0irq/26-eth0-rx-0-21swapper/308:03:543
29715030,0irq/26-eth0-rx-0-21swapper/307:53:503
29715030,0irq/26-eth0-rx-0-21swapper/307:48:533
29715030,0irq/26-eth0-rx-0-21swapper/307:38:563
29715030,0irq/26-eth0-rx-0-21swapper/307:13:533
29715030,0irq/26-eth0-rx-0-21swapper/307:03:543
29715030,0irq/26-eth0-rx-0-21swapper/306:53:543
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional