You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 20:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Fri Sep 04, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450760,0irq/25-eth10-21swapper/306:43:323
2664926261,0sleep10-21swapper/106:44:031
2665823322,0sleep00-21swapper/006:44:100
2637823127,0sleep20-21swapper/206:40:522
339960,0migration/38292-21aten_r1power_en09:35:043
339960,0migration/35150-21sh10:31:483
339960,0migration/331722-21sh08:46:503
339960,0migration/330569-21sh10:07:573
339960,0migration/330264-21fschecks_count11:10:063
339960,0migration/328196-21munin-node10:45:183
339960,0migration/320635-21sh11:45:003
339960,0migration/312316-21sh10:55:483
29725060,0irq/27-eth0-tx-23166-21munin-node07:55:150
267959960,0cyclictest8471-21cpu09:35:040
267959960,0cyclictest0-21swapper/010:47:260
149960,0migration/05276-21sh10:53:430
149960,0migration/031043-21ksmtuned10:09:240
149960,0migration/030353-21sh09:45:270
149960,0migration/028389-21sh11:06:250
149960,0migration/024411-21sh09:24:510
149960,0migration/019877-21sh11:21:380
149960,0migration/016956-21gltestperf09:40:040
149960,0migration/01657-21kthreadcore11:10:110
149960,0migration/014232-21munin-node09:15:110
149960,0migration/011119-21sh11:57:300
339950,0migration/36118-21runrttasks09:51:083
339950,0migration/35314-21kthreadcore08:50:093
339950,0migration/35251-21fschecks_count11:35:063
339950,0migration/331865-21kthreadcore08:00:093
339950,0migration/331678-21kthreadcore11:30:113
339950,0migration/330636-21latency_hist10:29:523
339950,0migration/328869-21munin-node07:35:043
339950,0migration/327167-21munin-node06:45:053
339950,0migration/323060-21munin-node11:05:123
339950,0migration/322976-21idleruntime07:30:053
339950,0migration/322374-21runrttasks10:02:143
339950,0migration/320874-21runrttasks10:41:103
339950,0migration/317223-21kthreadcore07:00:103
339950,0migration/316378-21munin-node07:25:073
339950,0migration/315514-21kthreadcore11:00:083
339950,0migration/314331-21mdstat08:55:113
339950,0migration/312450-21fschecks_time08:35:053
339950,0migration/312334-21kthreadcore10:15:103
339950,0migration/312039-21kthreadcore09:55:103
29725050,0irq/27-eth0-tx-6763-21sshd10:14:442
29725050,0irq/27-eth0-tx-3101-21munin-node07:40:060
29725050,0irq/27-eth0-tx-24706-21munin-node09:25:062
29725050,0irq/27-eth0-tx-14562-21fschecks_time11:00:052
29725050,0irq/27-eth0-tx-12605-21grep08:55:102
29725050,0irq/27-eth0-tx-0-21swapper/211:36:252
29725050,0irq/27-eth0-tx-0-21swapper/209:45:152
29725050,0irq/27-eth0-tx-0-21swapper/008:44:530
29725050,0irq/27-eth0-tx-0-21swapper/007:35:050
29715050,0irq/26-eth0-rx-6559-21runrttasks11:50:083
29715050,0irq/26-eth0-rx-3514-21snmpd11:22:173
29715050,0irq/26-eth0-rx-31578-21hddtemp_smartct08:25:073
29715050,0irq/26-eth0-rx-2826-21grep10:10:103
29715050,0irq/26-eth0-rx-25642-21if_eth109:25:093
29715050,0irq/26-eth0-rx-24766-21kthreadcore11:25:123
29715050,0irq/26-eth0-rx-2287-21aten2.4-expect07:15:053
29715050,0irq/26-eth0-rx-1459-21unixbench_singl07:10:153
29715050,0irq/26-eth0-rx-10211-21diskstats07:45:063
29715050,0irq/26-eth0-rx-0-21swapper/312:00:313
29715050,0irq/26-eth0-rx-0-21swapper/311:56:533
29715050,0irq/26-eth0-rx-0-21swapper/310:50:073
29715050,0irq/26-eth0-rx-0-21swapper/310:39:483
29715050,0irq/26-eth0-rx-0-21swapper/310:20:103
29715050,0irq/26-eth0-rx-0-21swapper/309:46:473
29715050,0irq/26-eth0-rx-0-21swapper/309:40:073
29715050,0irq/26-eth0-rx-0-21swapper/309:30:093
29715050,0irq/26-eth0-rx-0-21swapper/309:10:213
29715050,0irq/26-eth0-rx-0-21swapper/309:07:123
29715050,0irq/26-eth0-rx-0-21swapper/309:00:153
29715050,0irq/26-eth0-rx-0-21swapper/308:30:033
29715050,0irq/26-eth0-rx-0-21swapper/308:10:073
29715050,0irq/26-eth0-rx-0-21swapper/307:40:093
267979955,0cyclictest0-21swapper/209:06:152
267979950,0cyclictest0-21swapper/211:32:152
267979950,0cyclictest0-21swapper/211:24:222
267979950,0cyclictest0-21swapper/210:54:152
267979950,0cyclictest0-21swapper/209:44:442
267979950,0cyclictest0-21swapper/209:13:502
267969955,0cyclictest0-21swapper/110:22:291
267969955,0cyclictest0-21swapper/109:26:411
267969950,0cyclictest0-21swapper/111:48:061
267969950,0cyclictest0-21swapper/110:45:301
267969950,0cyclictest0-21swapper/110:35:531
267969950,0cyclictest0-21swapper/107:14:241
267959955,0cyclictest0-21swapper/011:28:350
267959955,0cyclictest0-21swapper/010:00:370
267959950,0cyclictest0-21swapper/010:28:120
259950,0migration/27503-21munin-node10:35:072
259950,0migration/229794-21munin-node08:20:142
19150,0ktimersoftd/10-21swapper/110:02:421
179950,0migration/129831-21kthreadcore06:45:101
179950,0migration/127115-21timerandwakeup11:25:181
179950,0migration/126155-21kthreadcore11:05:141
179950,0migration/124934-21kthreadcore12:05:081
179950,0migration/122956-21munin-node08:15:121
179950,0migration/113968-21aten_r1power_en11:00:031
179950,0migration/113430-21aten_r1power_vo11:20:031
179950,0migration/11114-21kthreadcore11:30:111
149950,0migration/08751-21latency_hist08:54:530
149950,0migration/06484-21aten_r1power_cu10:35:020
149950,0migration/03732-21kthreadcore07:15:100
149950,0migration/030394-21kthreadcore12:10:070
149950,0migration/029869-21kthreadcore07:10:080
149950,0migration/029856-21switchtime08:20:150
149950,0migration/029271-21kthreadcore09:05:090
149950,0migration/028895-21cpuspeed_turbos11:50:040
149950,0migration/027714-21taskset11:47:580
149950,0migration/020962-21kthreadcore08:15:100
149950,0migration/019275-21latency11:00:090
149950,0migration/017249-21munin-node08:35:100
149950,0migration/01260-21fschecks_time08:50:040
149950,0migration/012223-21taskset10:55:300
149950,0migration/010813-21taskset11:15:120
339940,0migration/39254-21kernelversion06:55:093
339940,0migration/37893-21kthreadcore11:15:103
339940,0migration/327168-21kthreadcore07:55:093
339940,0migration/310479-21taskset08:08:153
29725040,0irq/27-eth0-tx-9770-21tr09:55:092
29725040,0irq/27-eth0-tx-6941-21ssh09:31:442
29725040,0irq/27-eth0-tx-6207-21ssh09:51:232
29725040,0irq/27-eth0-tx-28990-21ssh10:46:352
29725040,0irq/27-eth0-tx-28587-21ssh11:49:572
29725040,0irq/27-eth0-tx-18700-21unixbench-2d11:40:142
29725040,0irq/27-eth0-tx-0-21swapper/212:10:562
29725040,0irq/27-eth0-tx-0-21swapper/211:54:552
29725040,0irq/27-eth0-tx-0-21swapper/211:25:572
29725040,0irq/27-eth0-tx-0-21swapper/210:41:572
29725040,0irq/27-eth0-tx-0-21swapper/210:30:102
29725040,0irq/27-eth0-tx-0-21swapper/210:26:432
29725040,0irq/27-eth0-tx-0-21swapper/210:20:122
29725040,0irq/27-eth0-tx-0-21swapper/210:05:152
29725040,0irq/27-eth0-tx-0-21swapper/210:01:392
29725040,0irq/27-eth0-tx-0-21swapper/209:15:072
29725040,0irq/27-eth0-tx-0-21swapper/209:00:062
29725040,0irq/27-eth0-tx-0-21swapper/008:41:580
29725040,0irq/27-eth0-tx-0-21swapper/008:00:580
29725040,0irq/27-eth0-tx-0-21swapper/007:30:010
29715040,0irq/26-eth0-rx-0-21swapper/312:10:023
29715040,0irq/26-eth0-rx-0-21swapper/312:05:033
29715040,0irq/26-eth0-rx-0-21swapper/311:40:393
29715040,0irq/26-eth0-rx-0-21swapper/309:20:023
29715040,0irq/26-eth0-rx-0-21swapper/309:15:093
29715040,0irq/26-eth0-rx-0-21swapper/307:24:543
29715040,0irq/26-eth0-rx-0-21swapper/307:24:543
27140,0ktimersoftd/20-21swapper/207:54:502
267979943,0cyclictest9110-21awk09:35:072
267979943,0cyclictest6228-21awk11:15:082
267979943,0cyclictest3556-21lldpd08:32:312
267979943,0cyclictest3556-21lldpd07:58:312
267979943,0cyclictest3556-21lldpd06:47:012
267979943,0cyclictest3514-21snmpd10:59:022
267979943,0cyclictest3514-21snmpd08:40:322
267979943,0cyclictest3514-21snmpd08:00:022
267979943,0cyclictest3514-21snmpd06:55:022
267979943,0cyclictest3514-21snmpd06:53:322
267979943,0cyclictest3241-21irqbalance10:15:512
267979943,0cyclictest3241-21irqbalance07:20:222
267979943,0cyclictest3241-21irqbalance07:20:222
267979943,0cyclictest26122-21awk08:45:072
267979943,0cyclictest22081-21awk07:05:072
267979943,0cyclictest1672-21awk08:50:062
267979943,0cyclictest16347-21awk07:25:072
267969943,0cyclictest9716-21awk07:20:071
267969943,0cyclictest9716-21awk07:20:071
267969943,0cyclictest7967-21awk10:15:071
267969943,0cyclictest3556-21lldpd12:10:321
267969943,0cyclictest3556-21lldpd12:01:021
267969943,0cyclictest3556-21lldpd08:20:011
267969943,0cyclictest3514-21snmpd09:55:171
267969943,0cyclictest3514-21snmpd08:25:171
267969943,0cyclictest3514-21snmpd06:50:171
267969943,0cyclictest29480-21awk11:50:061
267969943,0cyclictest1668-21awk09:10:061
267969943,0cyclictest15531-21awk07:00:081
267969943,0cyclictest15372-21awk10:40:061
267969943,0cyclictest1169-21awk09:30:071
267959944,0cyclictest0-21swapper/009:30:020
267959943,0cyclictest6182-21sadc10:34:520
267959943,0cyclictest586-21awk09:50:090
267959943,0cyclictest3514-21snmpd11:34:020
267959943,0cyclictest3241-21irqbalance12:06:210
267959943,0cyclictest3241-21irqbalance11:41:410
267959943,0cyclictest22159-21awk07:05:070
267959943,0cyclictest20994-21crond07:04:540
267959943,0cyclictest15944-21awk10:20:070
267959943,0cyclictest14109-21kworker/0:008:30:120
259940,0migration/229625-21idleruntime07:35:072
259940,0migration/228817-21if_eth107:10:062
259940,0migration/223293-21irqcore07:30:062
259940,0migration/222907-21irqcore11:05:122
259940,0migration/222639-21timerandwakeup09:20:142
259940,0migration/222560-21kthreadcore11:45:072
259940,0migration/220665-21fschecks_time12:05:032
259940,0migration/217452-21kthreadcore07:00:102
259940,0migration/216196-21kthreadcore12:00:102
249940,0watchdog/21520-21kthreadcore11:10:112
249940,0watchdog/214030-21kthreadcore08:10:112
249940,0watchdog/212808-21iostat_ios08:35:072
249940,0watchdog/20-21swapper/207:15:122
179940,0migration/19839-21kthreadcore09:35:091
179940,0migration/19589-21hddtemp_smartct09:15:061
179940,0migration/18319-21sh08:54:131
179940,0migration/18269-21kthreadcore10:55:111
179940,0migration/17503-21latency_hist09:54:521
179940,0migration/14142-21latency_hist11:54:521
179940,0migration/13115-21aten_r1power_cu07:40:041
179940,0migration/131044-21gltestperf10:50:031
179940,0migration/129982-21runrttasks10:06:101
179940,0migration/129549-21kthreadcore09:05:091
179940,0migration/128137-21kthreadcore10:25:141
179940,0migration/121928-21munin-node07:50:101
179940,0migration/12023-21kthreadcore10:10:101
179940,0migration/117272-21fschecks_count09:20:051
179940,0migration/116968-21latency_hist08:59:531
179940,0migration/116639-21fschecks_count09:40:041
179940,0migration/113448-21fschecks_time11:40:051
179940,0migration/112610-21kthreadcore07:45:101
179940,0migration/111114-21cpuspeed_turbos08:10:061
179940,0migration/110336-21kthreadcore08:30:091
169940,0watchdog/19426-21kthreadcore11:15:111
169940,0watchdog/18833-21ssh08:54:591
169940,0watchdog/13854-21chrt08:04:151
169940,0watchdog/129773-21ssh11:09:591
169940,0watchdog/127577-21chrt07:09:041
169940,0watchdog/126061-21kthreadcore07:30:071
169940,0watchdog/10-21swapper/107:55:071
169940,0watchdog/10-21swapper/107:15:121
149940,0migration/08518-21kthreadcore10:15:090
149940,0migration/023215-21sh09:00:270
29725030,0irq/27-eth0-tx-0-21swapper/007:50:020
29715030,0irq/26-eth0-rx-0-21swapper/308:40:043
29715030,0irq/26-eth0-rx-0-21swapper/308:20:033
29715030,0irq/26-eth0-rx-0-21swapper/308:19:073
29715030,0irq/26-eth0-rx-0-21swapper/307:06:053
29715030,0irq/26-eth0-rx-0-21swapper/306:50:123
267979932,0cyclictest4053-21awk07:40:082
267979932,0cyclictest31696-21awk08:25:082
267979932,0cyclictest15745-21grep07:45:162
267979930,0cyclictest20062-21cut08:15:092
267969933,0cyclictest0-21swapper/108:43:571
267969932,0cyclictest3514-21snmpd09:46:171
267969932,0cyclictest3514-21snmpd07:25:171
267969932,0cyclictest30885-21munin-node10:30:111
267969930,0cyclictest17943-40yum-updatesd-he08:36:131
267959933,0cyclictest5135-21awk08:05:080
267959933,0cyclictest14109-21kworker/0:012:00:120
267959933,0cyclictest14109-21kworker/0:011:35:040
267959933,0cyclictest14109-21kworker/0:010:39:540
267959933,0cyclictest14109-21kworker/0:010:10:140
267959933,0cyclictest14109-21kworker/0:009:24:560
267959933,0cyclictest14109-21kworker/0:009:10:020
267959933,0cyclictest14109-21kworker/0:008:24:540
267959933,0cyclictest14109-21kworker/0:008:09:560
267959933,0cyclictest14109-21kworker/0:007:44:570
267959933,0cyclictest14109-21kworker/0:007:24:570
267959933,0cyclictest14109-21kworker/0:007:19:550
267959933,0cyclictest14109-21kworker/0:007:19:550
267959933,0cyclictest14109-21kworker/0:006:54:570
267959933,0cyclictest14109-21kworker/0:006:50:010
267959933,0cyclictest14109-21kworker/0:006:44:550
267959932,0cyclictest8587-21awk09:55:080
169930,0watchdog/10-21swapper/111:35:061
169930,0watchdog/10-21swapper/108:48:151
169930,0watchdog/10-21swapper/107:35:151
169930,0watchdog/10-21swapper/106:55:081
329920,0watchdog/319568-21cut07:50:083
267979921,0cyclictest3930-21latency_hist08:04:532
169920,0watchdog/10-21swapper/108:04:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional