You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-06 - 22:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Sep 06, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
695427372,0sleep30-21swapper/306:42:183
709723423,0sleep00-21swapper/006:43:550
703823424,0sleep10-21swapper/106:43:161
687223425,0sleep20-21swapper/206:41:212
72289960,0cyclictest0-21swapper/210:35:572
72269960,0cyclictest0-21swapper/010:29:580
339960,0migration/327703-21munin-node08:55:033
339960,0migration/325130-21sh11:59:013
339960,0migration/323840-21munin-node11:35:023
339960,0migration/319585-21sh10:13:153
339960,0migration/316501-21sh12:13:333
339960,0migration/312244-21sh08:46:263
29725060,0irq/27-eth0-tx-27397-21munin-node07:00:022
29715060,0irq/26-eth0-rx-28992-21perl07:24:543
29715060,0irq/26-eth0-rx-16167-21chrt11:51:023
149960,0migration/028896-21sh09:17:420
8215050,0irq/24-0000:00:1066-21cat12:04:412
72289955,0cyclictest0-21swapper/210:05:502
72289955,0cyclictest0-21swapper/209:34:182
72289950,0cyclictest0-21swapper/210:56:362
72289950,0cyclictest0-21swapper/209:41:242
72269953,0cyclictest30631-21kworker/0:109:36:370
35150,0ktimersoftd/30-21swapper/308:50:283
339950,0migration/38259-21idleruntime06:44:553
339950,0migration/37777-21needreboot11:24:593
339950,0migration/36883-21munin-node09:04:583
339950,0migration/34884-21kthreadcore07:04:583
339950,0migration/34470-21taskset10:04:523
339950,0migration/330040-21missed_timers08:34:593
339950,0migration/329122-21kthreadcore10:59:563
339950,0migration/328459-21kthreadcore11:59:583
339950,0migration/327818-21aten_r1power_vo10:39:533
339950,0migration/32584-21latency_hist11:04:413
339950,0migration/324344-21kthreadcore09:54:583
339950,0migration/321812-21latency_hist09:14:423
339950,0migration/320473-21missed_timers07:15:013
339950,0migration/315704-21missed_timers08:00:003
339950,0migration/310541-21munin-node09:45:023
29725050,0irq/27-eth0-tx-5006-21kthreadcore11:24:572
29725050,0irq/27-eth0-tx-31600-21cat08:59:562
29725050,0irq/27-eth0-tx-31377-21munin-node08:40:012
29725050,0irq/27-eth0-tx-29338-21tr11:59:582
29725050,0irq/27-eth0-tx-22739-21munin-node07:45:032
29725050,0irq/27-eth0-tx-21365-21irqcore10:14:582
29725050,0irq/27-eth0-tx-20775-21munin-node06:55:012
29725050,0irq/27-eth0-tx-15438-21cut11:29:592
29725050,0irq/27-eth0-tx-12467-21sh10:09:522
29725050,0irq/27-eth0-tx-0-21swapper/210:45:372
29725050,0irq/27-eth0-tx-0-21swapper/210:30:322
29725050,0irq/27-eth0-tx-0-21swapper/210:19:532
29725050,0irq/27-eth0-tx-0-21swapper/209:25:512
29725050,0irq/27-eth0-tx-0-21swapper/209:07:502
29725050,0irq/27-eth0-tx-0-21swapper/208:48:452
29715050,0irq/26-eth0-rx-357-21kthreadcore08:14:593
29715050,0irq/26-eth0-rx-30867-21cut11:19:573
29715050,0irq/26-eth0-rx-26665-21fschecks_count11:39:533
29715050,0irq/26-eth0-rx-25095-21cut06:55:003
29715050,0irq/26-eth0-rx-24246-21chrt08:32:333
29715050,0irq/26-eth0-rx-23668-21tr09:34:583
29715050,0irq/26-eth0-rx-1927-21cpuspeed_turbos11:44:523
29715050,0irq/26-eth0-rx-18366-21kthreadcore09:09:583
29715050,0irq/26-eth0-rx-13882-21munin-node09:49:563
29715050,0irq/26-eth0-rx-0-21swapper/312:05:443
29715050,0irq/26-eth0-rx-0-21swapper/311:17:503
29715050,0irq/26-eth0-rx-0-21swapper/311:13:313
29715050,0irq/26-eth0-rx-0-21swapper/310:56:083
29715050,0irq/26-eth0-rx-0-21swapper/310:52:493
29715050,0irq/26-eth0-rx-0-21swapper/310:47:223
29715050,0irq/26-eth0-rx-0-21swapper/310:27:183
29715050,0irq/26-eth0-rx-0-21swapper/310:21:553
29715050,0irq/26-eth0-rx-0-21swapper/310:14:503
29715050,0irq/26-eth0-rx-0-21swapper/310:01:363
29715050,0irq/26-eth0-rx-0-21swapper/309:39:463
29715050,0irq/26-eth0-rx-0-21swapper/308:59:533
259950,0migration/29239-21sh11:05:582
259950,0migration/2527-21sh11:20:402
259950,0migration/232681-21munin-node10:59:592
259950,0migration/230851-21kthreadcore10:39:582
259950,0migration/230570-21gltestperf09:19:552
259950,0migration/228424-21kthreadcore11:39:572
259950,0migration/22417-21munin-node07:50:002
259950,0migration/220561-21munin-node07:15:012
259950,0migration/219736-21kthreadcore08:29:592
259950,0migration/216767-21taskset11:52:502
259950,0migration/216468-21sendmail_mailqu11:10:022
259950,0migration/214769-21munin-node12:10:032
259950,0migration/210183-21latency_hist07:59:422
249950,0watchdog/20-21swapper/209:35:042
179950,0migration/19040-21taskset07:33:091
179950,0migration/1430-21munin-node11:00:011
179950,0migration/13855-21timerwakeupswit08:15:051
179950,0migration/130971-21kthreadcore09:59:571
179950,0migration/129059-21runrttasks08:57:481
179950,0migration/126739-21taskset10:15:561
179950,0migration/126331-21sh09:54:591
179950,0migration/119369-21ntp_offset08:50:011
179950,0migration/115701-21sh12:11:081
179950,0migration/110164-21munin-node11:49:531
169950,0watchdog/16564-21ssh09:04:561
169950,0watchdog/10-21swapper/112:05:031
149950,0migration/09415-21kthreadcore08:19:590
149950,0migration/03904-21taskset10:04:020
149950,0migration/032325-21kthreadcore10:39:590
149950,0migration/032248-21kthreadcore09:19:590
149950,0migration/031766-21kthreadcore09:39:580
149950,0migration/029720-21kernelversion07:24:570
149950,0migration/027857-21kthreadcore11:39:570
149950,0migration/026991-21sh10:16:440
149950,0migration/025409-21kthreadcore06:55:000
149950,0migration/02460-21gltestperf11:44:530
149950,0migration/024284-21kthreadcore07:19:590
149950,0migration/023315-21kthreadcore10:55:000
149950,0migration/020435-21munin-node07:15:010
149950,0migration/019955-21sh09:31:150
149950,0migration/019456-21irqrtprio11:34:570
149950,0migration/019412-21mdstat06:50:010
149950,0migration/01797-21kthreadcore08:59:570
149950,0migration/017284-21munin-node08:04:530
149950,0migration/016358-21cpuspeed_turbos07:39:530
149950,0migration/013784-21taskset06:48:490
149950,0migration/012727-21kthreadcore10:49:570
149950,0migration/011257-21if_err_eth1.207:59:560
149950,0migration/011067-21latency_hist10:49:410
8215040,0irq/24-0000:00:0-21swapper/207:14:372
72289943,0cyclictest3514-21snmpd11:34:432
72289943,0cyclictest3514-21snmpd09:49:422
72289943,0cyclictest3514-21snmpd08:54:432
72289943,0cyclictest3514-21snmpd08:24:432
72289943,0cyclictest3514-21snmpd08:04:422
72289943,0cyclictest3514-21snmpd07:35:422
72289943,0cyclictest14767-21awk08:49:562
72289943,0cyclictest12147-21awk10:49:552
72279944,0cyclictest0-21swapper/110:39:541
72279944,0cyclictest0-21swapper/110:08:031
72279943,0cyclictest5927-21awk09:44:581
72279943,0cyclictest4580-21awk07:54:561
72279943,0cyclictest3556-21lldpd10:36:471
72279943,0cyclictest3556-21lldpd09:22:171
72279943,0cyclictest3556-21lldpd08:59:471
72279943,0cyclictest3514-21snmpd12:01:131
72279943,0cyclictest3514-21snmpd11:07:281
72279943,0cyclictest3514-21snmpd10:09:431
72279943,0cyclictest3514-21snmpd09:51:421
72279943,0cyclictest3514-21snmpd08:03:571
72279943,0cyclictest3514-21snmpd07:41:571
72279943,0cyclictest3514-21snmpd07:14:421
72279943,0cyclictest3241-21irqbalance10:30:091
72279943,0cyclictest2498-21awk07:04:541
72279943,0cyclictest20086-21awk10:54:571
72279943,0cyclictest19671-21awk11:14:581
72279943,0cyclictest18944-21sadc10:54:411
72279943,0cyclictest18582-21awk11:54:561
72279943,0cyclictest11252-21awk11:29:571
72279943,0cyclictest10271-21awk07:34:561
72269943,0cyclictest9274-21awk07:09:560
72269943,0cyclictest9139-21kworker/0:211:21:540
72269943,0cyclictest3514-21snmpd12:04:580
72269943,0cyclictest3241-21irqbalance12:00:190
72269943,0cyclictest3241-21irqbalance11:30:190
72269943,0cyclictest3241-21irqbalance10:36:590
72269943,0cyclictest3241-21irqbalance10:19:500
72269943,0cyclictest3241-21irqbalance10:09:500
72269943,0cyclictest3241-21irqbalance10:04:500
72269943,0cyclictest3241-21irqbalance09:55:100
72269943,0cyclictest3241-21irqbalance09:52:000
72269943,0cyclictest3241-21irqbalance09:47:000
72269943,0cyclictest3241-21irqbalance08:54:500
72269943,0cyclictest3241-21irqbalance08:49:500
72269943,0cyclictest30631-21kworker/0:110:25:190
72269943,0cyclictest19555-21awk11:14:570
72269943,0cyclictest18982-21awk08:29:580
72269943,0cyclictest1417-21sadc07:04:420
72269943,0cyclictest10349-21awk07:34:570
72269943,0cyclictest0-21swapper/008:29:420
339940,0migration/35746-21kthreadcore07:29:593
339940,0migration/331652-21cpuspeed_turbos08:39:543
339940,0migration/323001-21irqrtprio07:19:583
339940,0migration/321470-21kthreadcore10:34:593
339940,0migration/318056-21kthreadcore07:39:583
29725040,0irq/27-eth0-tx-3814-21munin-node10:24:532
29725040,0irq/27-eth0-tx-23698-21munin-node08:10:032
29725040,0irq/27-eth0-tx-21784-21munin-node07:19:552
29725040,0irq/27-eth0-tx-0-21swapper/211:44:462
29725040,0irq/27-eth0-tx-0-21swapper/209:59:492
29725040,0irq/27-eth0-tx-0-21swapper/209:14:572
29725040,0irq/27-eth0-tx-0-21swapper/209:09:572
29725040,0irq/27-eth0-tx-0-21swapper/208:36:452
29715040,0irq/26-eth0-rx-3514-21snmpd07:44:573
29715040,0irq/26-eth0-rx-22073-21kthreadcore08:04:583
29715040,0irq/26-eth0-rx-0-21swapper/311:29:503
29715040,0irq/26-eth0-rx-0-21swapper/310:30:013
29715040,0irq/26-eth0-rx-0-21swapper/309:30:463
29715040,0irq/26-eth0-rx-0-21swapper/309:25:323
29715040,0irq/26-eth0-rx-0-21swapper/309:19:423
29715040,0irq/26-eth0-rx-0-21swapper/307:54:543
29715040,0irq/26-eth0-rx-0-21swapper/306:59:593
259940,0migration/28083-21munin-node06:44:542
259940,0migration/228675-21cpuspeed_turbos07:24:532
259940,0migration/221353-21kthreadcore11:54:582
259940,0migration/220820-21ksmtuned09:54:442
259940,0migration/219501-21kthreadcore07:39:582
259940,0migration/214885-21hwlatdetect06:49:572
249940,0watchdog/27665-21kthreadcore09:44:592
249940,0watchdog/23509-21idleruntime07:29:562
249940,0watchdog/211228-21if_err_eth107:59:562
249940,0watchdog/20-21swapper/211:14:592
19140,0ktimersoftd/10-21swapper/107:27:451
179940,0migration/19704-21irqrtprio07:09:581
179940,0migration/14646-21idleruntime10:24:551
179940,0migration/131991-21kthreadcore07:49:581
179940,0migration/128955-21kthreadcore11:19:571
179940,0migration/128120-21kthreadcore08:10:021
179940,0migration/117994-21latency_hist08:29:421
179940,0migration/117453-21runrttasks11:11:511
169940,0watchdog/18706-21ssh11:25:511
169940,0watchdog/17819-21munin-node11:45:031
169940,0watchdog/17005-21cut08:45:001
169940,0watchdog/16559-21runrttasks09:19:161
169940,0watchdog/13753-21ksmtuned08:43:441
169940,0watchdog/13342-21ssh09:40:471
169940,0watchdog/126531-21kthreadcore09:35:001
169940,0watchdog/117086-21aten_r1power_en08:04:521
169940,0watchdog/114801-21perl06:49:561
169940,0watchdog/110049-21runrttasks10:46:471
149940,0migration/09806-21fschecks_count12:09:570
149940,0migration/07093-21kthreadcore11:24:580
149940,0migration/028861-21kthreadcore10:59:560
149940,0migration/026421-21kthreadcore07:44:580
149940,0migration/015371-21kthreadcore09:09:570
149940,0migration/011840-21unixbench-2d09:05:050
72289932,0cyclictest899-21kthreadcore08:14:592
72289932,0cyclictest5529-21awk08:19:562
72279932,0cyclictest6354-21awk09:24:561
72279932,0cyclictest5584-21awk08:19:561
72279932,0cyclictest3514-21snmpd06:59:421
72279932,0cyclictest3514-21snmpd06:54:421
72279932,0cyclictest3514-21snmpd06:47:421
72279932,0cyclictest25663-21awk08:34:561
72279932,0cyclictest23622-21awk07:44:551
72279932,0cyclictest22622-21awk07:19:561
72279932,0cyclictest19695-21sensors09:10:031
72279932,0cyclictest19072-21awk11:34:551
72269933,0cyclictest9139-21kworker/0:211:54:440
72269933,0cyclictest9139-21kworker/0:211:49:420
72269933,0cyclictest9139-21kworker/0:211:09:420
72269933,0cyclictest9139-21kworker/0:211:04:440
72269933,0cyclictest30631-21kworker/0:109:24:430
72269933,0cyclictest26078-21kworker/0:008:44:430
72269933,0cyclictest26078-21kworker/0:008:34:450
72269933,0cyclictest26078-21kworker/0:008:14:430
72269933,0cyclictest26078-21kworker/0:008:09:430
72269933,0cyclictest26078-21kworker/0:007:54:450
72269933,0cyclictest26078-21kworker/0:007:49:450
72269933,0cyclictest26078-21kworker/0:007:29:430
72269933,0cyclictest26078-21kworker/0:007:04:470
72269930,0cyclictest31322-21latency_hist08:39:420
29725030,0irq/27-eth0-tx-0-21swapper/207:04:532
29715030,0irq/26-eth0-rx-0-21swapper/308:23:133
29715030,0irq/26-eth0-rx-0-21swapper/307:49:483
29715030,0irq/26-eth0-rx-0-21swapper/307:12:493
169930,0watchdog/10-21swapper/111:42:151
169930,0watchdog/10-21swapper/110:20:231
169930,0watchdog/10-21swapper/109:30:001
72279920,0cyclictest0-21swapper/108:24:431
35120,0ktimersoftd/318163-21kthreadcore06:50:003
35120,0ktimersoftd/316758-21needreboot08:25:003
29715020,0irq/26-eth0-rx-0-21swapper/308:09:513
29715020,0irq/26-eth0-rx-0-21swapper/307:34:473
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional