You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 17:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sat Jul 25, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450570,0irq/25-eth10-21swapper/306:48:423
2613325251,0sleep20-21swapper/206:44:512
2640723725,0sleep00-21swapper/006:48:050
2611023122,0sleep10-21swapper/106:44:341
265399976,0cyclictest0-21swapper/011:46:150
265399976,0cyclictest0-21swapper/010:35:180
339960,0migration/39851-21sh12:01:123
339960,0migration/312903-21munin-node08:39:053
29725060,0irq/27-eth0-tx-27714-21munin-node07:14:070
29715060,0irq/26-eth0-rx-7695-21kthreadcore10:19:053
29715060,0irq/26-eth0-rx-31881-21cut07:14:063
29715060,0irq/26-eth0-rx-21121-21grep12:09:053
8215050,0irq/24-0000:00:20822-21latency_hist07:08:482
4150,0ktimersoftd/00-21swapper/009:40:070
339950,0migration/39296-21kthreadcore09:39:073
339950,0migration/3863-21munin-node09:34:053
339950,0migration/38506-21pmu-power07:44:113
339950,0migration/37424-21kthreadcore10:59:043
339950,0migration/332506-21kthreadcore11:14:063
339950,0migration/328534-21kthreadcore06:49:053
339950,0migration/325053-21kthreadcore07:59:063
339950,0migration/324287-21kthreadcore10:49:063
339950,0migration/324186-21kthreadcore10:29:083
339950,0migration/320654-21irqcore11:49:053
339950,0migration/319325-21munin-node10:44:093
339950,0migration/316742-21fschecks_count09:24:023
339950,0migration/31548-21kthreadcore08:04:063
339950,0migration/313988-21taskset07:01:493
339950,0migration/31392-21sh12:16:473
339950,0migration/313880-21kthreadcore11:24:043
339950,0migration/311089-21munin-node12:04:003
339950,0migration/310001-21kthreadcore08:59:053
29725050,0irq/27-eth0-tx-7721-21munin-node06:59:090
29725050,0irq/27-eth0-tx-30594-21kthreadcore11:54:042
29725050,0irq/27-eth0-tx-18324-21munin-node08:44:050
29715050,0irq/26-eth0-rx-917-21tune2fs09:14:013
29715050,0irq/26-eth0-rx-6965-21ssh09:58:503
29715050,0irq/26-eth0-rx-6333-21mdstat06:54:053
29715050,0irq/26-eth0-rx-2283-21kthreadcore10:34:053
29715050,0irq/26-eth0-rx-15696-21kthreadcore10:24:053
29715050,0irq/26-eth0-rx-15627-21kthreadcore11:04:023
29715050,0irq/26-eth0-rx-1498-21kthreadcore08:29:073
29715050,0irq/26-eth0-rx-14046-21kthreadcore11:44:063
29715050,0irq/26-eth0-rx-11251-21seq11:21:333
29715050,0irq/26-eth0-rx-0-21swapper/311:55:083
29715050,0irq/26-eth0-rx-0-21swapper/311:42:463
29715050,0irq/26-eth0-rx-0-21swapper/311:35:273
29715050,0irq/26-eth0-rx-0-21swapper/311:29:093
29715050,0irq/26-eth0-rx-0-21swapper/310:54:003
29715050,0irq/26-eth0-rx-0-21swapper/310:41:043
29715050,0irq/26-eth0-rx-0-21swapper/310:15:383
29715050,0irq/26-eth0-rx-0-21swapper/310:08:313
29715050,0irq/26-eth0-rx-0-21swapper/309:49:063
29715050,0irq/26-eth0-rx-0-21swapper/309:48:213
29715050,0irq/26-eth0-rx-0-21swapper/309:19:463
29715050,0irq/26-eth0-rx-0-21swapper/309:13:013
29715050,0irq/26-eth0-rx-0-21swapper/308:57:073
29715050,0irq/26-eth0-rx-0-21swapper/307:39:073
265419955,0cyclictest24730-21diskmemload09:10:312
265419955,0cyclictest0-21swapper/210:53:002
265419955,0cyclictest0-21swapper/209:45:122
265419955,0cyclictest0-21swapper/208:42:182
265419950,0cyclictest0-21swapper/211:41:432
265419950,0cyclictest0-21swapper/210:29:402
265419950,0cyclictest0-21swapper/210:05:232
265419950,0cyclictest0-21swapper/209:26:552
265409955,0cyclictest17400-21sensors11:44:111
265409950,0cyclictest0-21swapper/110:28:091
265399955,0cyclictest0-21swapper/012:05:480
265399955,0cyclictest0-21swapper/010:42:420
265399950,0cyclictest0-21swapper/011:31:350
265399950,0cyclictest0-21swapper/010:01:430
265399950,0cyclictest0-21swapper/009:34:260
249950,0watchdog/210509-21kthreadcore09:59:052
249950,0watchdog/20-21swapper/211:16:452
249950,0watchdog/20-21swapper/208:19:062
179950,0migration/14501-21missed_timers09:54:061
179950,0migration/130338-21cpuspeed_turbos10:33:591
179950,0migration/129550-21latency09:29:071
179950,0migration/128659-21switchtime10:09:121
179950,0migration/126055-21kthreadcore07:34:061
179950,0migration/119373-21kthreadcore07:04:061
179950,0migration/11294-21munin-node07:14:121
169950,0watchdog/130185-21grep08:04:021
149950,0migration/031692-21sh09:11:270
149950,0migration/025149-21irqrtprio08:24:030
149950,0migration/022245-21unixbench_singl07:54:120
149950,0migration/022012-21sh10:07:110
149950,0migration/021727-21kthreadcore09:04:060
149950,0migration/021727-21kthreadcore09:04:060
149950,0migration/021323-21latency_hist10:48:470
149950,0migration/019857-21kthreadcore09:24:060
149950,0migration/016417-21kthreadcore07:04:050
149950,0migration/01211-21kthreadcore08:29:070
8215040,0irq/24-0000:00:11356-21latency_hist11:43:472
339940,0migration/39751-21irqcore07:24:053
339940,0migration/327637-21sendmail_mailst07:34:103
339940,0migration/327034-21kthreadcore09:29:073
339940,0migration/318413-21kthreadcore07:54:053
29725040,0irq/27-eth0-tx-30267-21ssh09:51:002
29725040,0irq/27-eth0-tx-30085-21ssh10:33:552
29725040,0irq/27-eth0-tx-18832-21ssh11:04:082
29725040,0irq/27-eth0-tx-0-21swapper/212:14:032
29725040,0irq/27-eth0-tx-0-21swapper/212:09:032
29725040,0irq/27-eth0-tx-0-21swapper/211:24:302
29725040,0irq/27-eth0-tx-0-21swapper/210:56:512
29725040,0irq/27-eth0-tx-0-21swapper/210:24:062
29725040,0irq/27-eth0-tx-0-21swapper/210:11:462
29725040,0irq/27-eth0-tx-0-21swapper/209:39:362
29725040,0irq/27-eth0-tx-0-21swapper/209:34:032
29725040,0irq/27-eth0-tx-0-21swapper/208:55:472
29725040,0irq/27-eth0-tx-0-21swapper/008:39:030
29725040,0irq/27-eth0-tx-0-21swapper/008:19:050
29725040,0irq/27-eth0-tx-0-21swapper/006:49:010
29715040,0irq/26-eth0-rx-0-21swapper/311:10:373
29715040,0irq/26-eth0-rx-0-21swapper/310:09:003
29715040,0irq/26-eth0-rx-0-21swapper/309:55:233
29715040,0irq/26-eth0-rx-0-21swapper/309:05:113
29715040,0irq/26-eth0-rx-0-21swapper/309:05:113
29715040,0irq/26-eth0-rx-0-21swapper/308:49:073
265419943,0cyclictest9392-21awk08:59:032
265419943,0cyclictest6550-21awk10:39:032
265419943,0cyclictest3514-21snmpd09:04:452
265419943,0cyclictest3514-21snmpd09:04:452
265419943,0cyclictest3514-21snmpd08:26:442
265419943,0cyclictest3241-21irqbalance11:20:352
265419943,0cyclictest3241-21irqbalance07:14:562
265419943,0cyclictest3241-21irqbalance07:11:362
265419943,0cyclictest32341-21awk09:54:022
265419943,0cyclictest31779-21ps08:29:062
265419943,0cyclictest2849-21awk07:19:042
265419943,0cyclictest27684-21awk06:49:032
265419943,0cyclictest25898-21awk08:49:052
265419943,0cyclictest22947-21awk07:34:042
265419943,0cyclictest1849-21awk06:54:022
265419943,0cyclictest11844-21awk12:04:032
265419943,0cyclictest11497-21awk08:14:032
265419940,0cyclictest24181-21munin-node09:29:132
265409944,0cyclictest0-21swapper/111:19:131
265409943,0cyclictest7366-21awk10:19:041
265409943,0cyclictest5930-21awk10:59:021
265409943,0cyclictest3882-21awk07:44:061
265409943,0cyclictest3514-21snmpd11:24:171
265409943,0cyclictest3514-21snmpd11:16:171
265409943,0cyclictest3514-21snmpd10:08:161
265409943,0cyclictest3514-21snmpd09:44:161
265409943,0cyclictest3514-21snmpd08:23:591
265409943,0cyclictest31708-21awk10:14:041
265409943,0cyclictest27801-21awk12:14:051
265409943,0cyclictest17162-21awk09:24:031
265409940,0cyclictest0-21swapper/108:58:071
265399944,0cyclictest0-21swapper/010:10:420
265399943,0cyclictest8250-21sadc08:58:480
265399943,0cyclictest6052-21sadc10:18:470
265399943,0cyclictest5743-21kworker/0:211:21:260
265399943,0cyclictest3556-21lldpd12:14:110
265399943,0cyclictest3556-21lldpd08:16:100
265399943,0cyclictest3241-21irqbalance11:58:550
265399943,0cyclictest3241-21irqbalance11:49:250
265399943,0cyclictest3241-21irqbalance11:24:450
265399943,0cyclictest3241-21irqbalance11:09:050
265399943,0cyclictest3241-21irqbalance10:55:050
265399943,0cyclictest3241-21irqbalance10:24:450
265399943,0cyclictest3241-21irqbalance08:34:060
265399943,0cyclictest3241-21irqbalance07:49:060
265399943,0cyclictest3241-21irqbalance07:43:560
265399943,0cyclictest3241-21irqbalance07:38:560
265399943,0cyclictest3241-21irqbalance07:34:360
265399943,0cyclictest3241-21irqbalance07:28:560
265399943,0cyclictest30514-21awk08:04:040
265399943,0cyclictest28469-21awk11:54:020
265399943,0cyclictest25874-21awk08:49:050
265399943,0cyclictest24431-21awk09:49:040
265399943,0cyclictest1953-21munin-node07:19:020
259940,0migration/26065-21kthreadcore11:59:062
259940,0migration/25889-21kthreadcore07:44:082
259940,0migration/231702-21kthreadcore08:04:062
259940,0migration/22275-21kthreadcore09:14:052
259940,0migration/222487-21kthreadcore11:09:052
259940,0migration/221321-21kthreadcore11:49:052
259940,0migration/220463-21cpuspeed_turbos11:29:012
259940,0migration/218449-21kthreadcore07:29:052
259940,0migration/214035-21fschecks_count10:44:002
259940,0migration/210248-21kthreadcore09:19:042
259940,0migration/210201-21runrttasks08:11:222
249940,0watchdog/28759-21tr10:19:052
249940,0watchdog/232329-21kthreadcore11:34:052
249940,0watchdog/220253-21cut07:54:062
249940,0watchdog/210820-21kthreadcore06:59:062
249940,0watchdog/20-21swapper/210:59:052
249940,0watchdog/20-21swapper/210:14:012
249940,0watchdog/20-21swapper/208:44:062
179940,0migration/17608-21latency_hist06:58:481
179940,0migration/15059-21kthreadcore11:59:061
179940,0migration/12969-21kthreadcore09:14:051
179940,0migration/128971-21kthreadcore06:49:051
179940,0migration/127336-21kthreadcore09:49:061
179940,0migration/126002-21irqrtprio09:09:051
179940,0migration/121302-21kthreadcore11:49:051
179940,0migration/120117-21irqrtprio12:09:041
179940,0migration/114689-21irqcore10:44:021
179940,0migration/111695-21kthreadcore09:39:081
179940,0migration/111168-21kthreadcore07:49:061
179940,0migration/111105-21kthreadcore06:59:051
179940,0migration/110938-21kthreadcore10:39:061
169940,0watchdog/14205-21unixbench_multi08:29:141
169940,0watchdog/132720-21cut10:54:051
169940,0watchdog/129051-21ssh10:53:331
169940,0watchdog/128010-21ssh11:12:251
169940,0watchdog/117238-21grep09:04:021
169940,0watchdog/117238-21grep09:04:021
169940,0watchdog/114772-21ssh08:59:261
169940,0watchdog/110510-21kthreadcore09:59:051
169940,0watchdog/10-21swapper/111:53:571
169940,0watchdog/10-21swapper/111:39:051
169940,0watchdog/10-21swapper/111:38:011
169940,0watchdog/10-21swapper/110:28:491
169940,0watchdog/10-21swapper/108:49:061
169940,0watchdog/10-21swapper/107:29:141
149940,0migration/04393-21kthreadcore09:14:060
149940,0migration/03599-21taskset11:38:480
149940,0migration/027123-21kthreadcore09:29:070
149940,0migration/025928-21kthreadcore10:29:080
149940,0migration/022747-21irqrtprio10:49:050
149940,0migration/021066-21missed_timers09:44:080
149940,0migration/019481-21fschecks_time12:09:020
149940,0migration/013953-21mdstat08:59:060
149940,0migration/012759-21kthreadcore09:19:050
149940,0migration/01072-21sh11:34:060
149940,0migration/010547-21kthreadcore07:24:060
8215030,0irq/24-0000:00:0-21swapper/207:49:122
29715030,0irq/26-eth0-rx-0-21swapper/308:33:593
29715030,0irq/26-eth0-rx-0-21swapper/308:27:233
29715030,0irq/26-eth0-rx-0-21swapper/308:19:023
29715030,0irq/26-eth0-rx-0-21swapper/308:14:003
29715030,0irq/26-eth0-rx-0-21swapper/308:09:073
29715030,0irq/26-eth0-rx-0-21swapper/307:29:003
29715030,0irq/26-eth0-rx-0-21swapper/307:19:003
29715030,0irq/26-eth0-rx-0-21swapper/307:10:163
29715030,0irq/26-eth0-rx-0-21swapper/307:04:003
265419932,0cyclictest5894-21awk08:34:032
265419932,0cyclictest29634-21awk07:39:032
265419930,0cyclictest23646-21gltestperf07:59:032
265409933,0cyclictest13789-21awk11:04:001
265409932,0cyclictest8770-21forks09:19:011
265409932,0cyclictest3514-21snmpd12:04:171
265409932,0cyclictest3514-21snmpd08:34:001
265409932,0cyclictest29507-21awk07:39:021
265409932,0cyclictest21095-21awk11:29:041
265409932,0cyclictest17317-21sensors08:39:101
265409932,0cyclictest10963-21grep08:14:011
265409930,0cyclictest4570-21munin-node08:09:031
265399933,0cyclictest5743-21kworker/0:211:13:520
265399933,0cyclictest11884-21kworker/0:010:58:480
265399933,0cyclictest11884-21kworker/0:010:18:480
265399933,0cyclictest11884-21kworker/0:009:53:480
265399933,0cyclictest11884-21kworker/0:008:08:510
265399933,0cyclictest11884-21kworker/0:007:58:530
265399933,0cyclictest11884-21kworker/0:007:08:490
265399933,0cyclictest11884-21kworker/0:006:53:490
265399930,0cyclictest13926-21iostat_ios11:04:010
179930,0migration/15921-21ksmtuned09:34:181
169930,0watchdog/10-21swapper/108:44:061
169930,0watchdog/10-21swapper/108:19:061
169930,0watchdog/10-21swapper/107:59:061
169930,0watchdog/10-21swapper/107:54:061
169930,0watchdog/10-21swapper/107:24:061
169930,0watchdog/10-21swapper/107:19:061
169930,0watchdog/10-21swapper/107:09:101
29715020,0irq/26-eth0-rx-0-21swapper/308:43:583
29715020,0irq/26-eth0-rx-0-21swapper/307:48:483
265419920,0cyclictest0-21swapper/207:23:482
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional