You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-11 - 16:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sat Apr 11, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450350,0irq/25-eth10-21swapper/306:55:073
2042923430,0sleep00-21swapper/006:55:400
2049823324,0sleep10-21swapper/106:56:291
2041823324,0sleep20-21swapper/206:55:342
2076599130,0cyclictest0-21swapper/008:59:050
339980,0migration/317316-21sh10:14:393
339970,0migration/332339-21sh11:45:143
339960,0migration/326953-21munin-node11:03:593
339960,0migration/325632-21sh10:20:373
339960,0migration/324519-21sh12:22:373
339960,0migration/31745-21sh10:27:093
339960,0migration/310642-21sh10:33:503
29725060,0irq/27-eth0-tx-21962-21munin-node07:24:050
207659960,0cyclictest0-21swapper/009:48:360
207659960,0cyclictest0-21swapper/007:09:120
149960,0migration/0933-21sh11:06:130
149960,0migration/02878-21switchtime07:54:100
149960,0migration/027686-21fschecks_time10:24:000
149960,0migration/024561-21sh12:22:450
149960,0migration/019315-21kthreadcore08:09:050
149960,0migration/016563-21sh11:56:520
149960,0migration/016528-21switchtime10:34:100
149960,0migration/012012-21kthreadcore12:14:020
149960,0migration/011755-21gltestperf10:14:010
8215050,0irq/24-0000:00:22831-21cat07:48:472
35150,0ktimersoftd/30-21swapper/312:04:133
339950,0migration/38633-21switchtime07:34:093
339950,0migration/36869-21kthreadcore11:29:023
339950,0migration/34160-21gltestperf09:29:013
339950,0migration/33938-21if_eth1.210:09:013
339950,0migration/33938-21if_eth1.210:09:013
339950,0migration/331114-21taskset08:41:233
339950,0migration/325889-21kthreadcore07:24:043
339950,0migration/32332-21fschecks_count07:09:003
339950,0migration/321877-21munin-node07:44:083
339950,0migration/321425-21kthreadcore10:59:023
339950,0migration/320040-21hddtemp_smartct09:59:003
339950,0migration/311875-21kthreadcore07:39:063
339950,0migration/311495-21munin-node11:14:023
29725050,0irq/27-eth0-tx-26990-21munin-node10:24:002
29725050,0irq/27-eth0-tx-19391-21sed11:19:032
29725050,0irq/27-eth0-tx-16793-21uptime10:34:102
29725050,0irq/27-eth0-tx-15197-21load11:34:042
29725050,0irq/27-eth0-tx-10481-21munin-node10:54:082
29725050,0irq/27-eth0-tx-0-21swapper/212:09:052
29725050,0irq/27-eth0-tx-0-21swapper/211:44:582
29725050,0irq/27-eth0-tx-0-21swapper/210:21:422
29725050,0irq/27-eth0-tx-0-21swapper/210:17:212
29725050,0irq/27-eth0-tx-0-21swapper/007:34:100
29715050,0irq/26-eth0-rx-6394-21cut07:59:043
29715050,0irq/26-eth0-rx-31726-21ssh12:25:223
29715050,0irq/26-eth0-rx-28133-21sed09:23:593
29715050,0irq/26-eth0-rx-28020-21gltestperf09:04:013
29715050,0irq/26-eth0-rx-26000-21kthreadcore07:49:053
29715050,0irq/26-eth0-rx-2232-21idleruntime11:48:593
29715050,0irq/26-eth0-rx-21820-21kthreadcore10:39:043
29715050,0irq/26-eth0-rx-20940-21cut11:59:033
29715050,0irq/26-eth0-rx-17135-21kthreadcore07:19:033
29715050,0irq/26-eth0-rx-16446-21ssh11:56:323
29715050,0irq/26-eth0-rx-13868-21kthreadcore09:34:033
29715050,0irq/26-eth0-rx-0-21swapper/311:40:063
29715050,0irq/26-eth0-rx-0-21swapper/311:24:023
29715050,0irq/26-eth0-rx-0-21swapper/311:09:323
29715050,0irq/26-eth0-rx-0-21swapper/310:54:013
29715050,0irq/26-eth0-rx-0-21swapper/310:50:493
29715050,0irq/26-eth0-rx-0-21swapper/310:04:043
29715050,0irq/26-eth0-rx-0-21swapper/309:53:593
29715050,0irq/26-eth0-rx-0-21swapper/309:49:073
29715050,0irq/26-eth0-rx-0-21swapper/309:39:193
29715050,0irq/26-eth0-rx-0-21swapper/309:22:353
29715050,0irq/26-eth0-rx-0-21swapper/309:12:463
29715050,0irq/26-eth0-rx-0-21swapper/309:00:083
259950,0migration/28981-21sh11:53:042
259950,0migration/28154-21kthreadcore08:49:032
259950,0migration/27664-21munin-node07:09:082
259950,0migration/27462-21kthreadcore10:09:032
259950,0migration/27462-21kthreadcore10:09:032
259950,0migration/230023-21kthreadcore07:04:042
259950,0migration/22880-21cpuspeed_turbos10:28:582
259950,0migration/226136-21sh10:42:582
259950,0migration/222753-21latency_hist07:48:472
259950,0migration/222281-21kthreadcore09:19:032
259950,0migration/217482-21sh11:17:322
259950,0migration/215072-21open_files11:54:072
259950,0migration/21117-21sh10:04:222
249950,0watchdog/232453-21kthreadcore07:54:052
249950,0watchdog/230835-21ls12:04:042
207679955,0cyclictest0-21swapper/212:21:562
207679955,0cyclictest0-21swapper/210:52:422
207679955,0cyclictest0-21swapper/209:42:142
207679950,0cyclictest0-21swapper/210:48:082
207679950,0cyclictest0-21swapper/209:09:452
207669955,0cyclictest0-21swapper/109:39:101
207669950,0cyclictest0-21swapper/112:10:221
207669950,0cyclictest0-21swapper/109:14:061
207659950,0cyclictest0-21swapper/010:07:030
179950,0migration/14435-21kthreadcore10:09:021
179950,0migration/14435-21kthreadcore10:09:021
179950,0migration/13819-21kthreadcore07:09:031
179950,0migration/131833-21kthreadcore07:54:051
179950,0migration/131207-21kthreadcore09:04:041
179950,0migration/12733-21latency_hist07:33:471
179950,0migration/120174-21kthreadcore12:19:021
179950,0migration/120028-21hddtemp_smartct08:58:591
179950,0migration/119575-21kthreadcore11:59:031
179950,0migration/117504-21sh10:56:461
179950,0migration/115856-21munin-node11:14:071
179950,0migration/115838-21kthreadcore10:14:051
169950,0watchdog/129974-21kthreadcore12:24:041
169950,0watchdog/111257-21missed_timers08:49:051
149950,0migration/08755-21taskset11:52:220
149950,0migration/08671-21taskset10:29:090
149950,0migration/0451-21runrttasks12:07:500
149950,0migration/032356-21kthreadcore09:04:050
149950,0migration/030569-21sh12:24:050
149950,0migration/029790-21unixbench-2d08:14:080
149950,0migration/027143-21taskset07:00:380
149950,0migration/02694-21fschecks_time11:09:010
149950,0migration/025611-21taskset11:01:560
149950,0migration/025156-21sh11:42:340
149950,0migration/023047-21aten_r1power_vo07:49:000
149950,0migration/02206-21kthreadcore08:44:030
149950,0migration/021956-21kthreadcore10:19:030
149950,0migration/021591-21kthreadcore09:19:020
149950,0migration/020787-21kthreadcore08:34:040
149950,0migration/020447-21kthreadcore11:19:040
149950,0migration/01923-21kthreadcore08:19:050
149950,0migration/017677-21taskset10:57:150
149950,0migration/015958-21munin-node08:04:060
149950,0migration/014239-21kthreadcore09:34:040
149950,0migration/01246-21taskset10:46:300
149950,0migration/011943-21kthreadcore11:34:030
149950,0migration/010481-21sh09:31:400
8215040,0irq/24-0000:00:0-21swapper/209:48:472
8215040,0irq/24-0000:00:0-21swapper/207:28:472
339940,0migration/330796-21kthreadcore07:29:033
339940,0migration/330143-21taskset08:16:503
339940,0migration/328164-21kthreadcore10:44:023
339940,0migration/324577-21taskset08:38:183
339940,0migration/317851-21taskset08:32:313
339940,0migration/313548-21kthreadcore08:04:053
339940,0migration/311070-21kthreadcore08:49:043
339940,0migration/310031-21kthreadcore08:24:063
29725040,0irq/27-eth0-tx-8086-21ssh11:29:272
29725040,0irq/27-eth0-tx-3376-21ssh09:28:582
29725040,0irq/27-eth0-tx-27795-21ssh09:23:582
29725040,0irq/27-eth0-tx-26995-21smartctl11:23:592
29725040,0irq/27-eth0-tx-0-21swapper/212:26:242
29725040,0irq/27-eth0-tx-0-21swapper/212:14:502
29725040,0irq/27-eth0-tx-0-21swapper/212:02:182
29725040,0irq/27-eth0-tx-0-21swapper/211:39:082
29725040,0irq/27-eth0-tx-0-21swapper/211:08:592
29725040,0irq/27-eth0-tx-0-21swapper/211:04:032
29725040,0irq/27-eth0-tx-0-21swapper/209:58:502
29725040,0irq/27-eth0-tx-0-21swapper/209:53:522
29725040,0irq/27-eth0-tx-0-21swapper/209:33:532
29725040,0irq/27-eth0-tx-0-21swapper/209:14:292
29725040,0irq/27-eth0-tx-0-21swapper/209:00:192
29725040,0irq/27-eth0-tx-0-21swapper/008:26:320
29715040,0irq/26-eth0-rx-0-21swapper/312:14:273
29715040,0irq/26-eth0-rx-0-21swapper/312:09:013
29715040,0irq/26-eth0-rx-0-21swapper/311:33:593
29715040,0irq/26-eth0-rx-0-21swapper/311:19:233
29715040,0irq/26-eth0-rx-0-21swapper/310:28:473
29715040,0irq/26-eth0-rx-0-21swapper/309:43:523
29715040,0irq/26-eth0-rx-0-21swapper/309:14:533
259940,0migration/223813-21latency_hist08:13:472
259940,0migration/220321-21kthreadcore08:09:052
259940,0migration/219337-21kthreadcore07:19:042
259940,0migration/217189-21kthreadcore08:54:042
249940,0watchdog/29225-21perl07:14:012
249940,0watchdog/28070-21kthreadcore07:59:052
249940,0watchdog/22779-21cut08:19:052
249940,0watchdog/20-21swapper/209:44:042
249940,0watchdog/20-21swapper/209:04:052
249940,0watchdog/20-21swapper/208:04:052
207679943,0cyclictest3786-21awk07:34:022
207679943,0cyclictest3556-21lldpd08:30:572
207679943,0cyclictest3514-21snmpd08:47:392
207679943,0cyclictest3514-21snmpd08:36:392
207679943,0cyclictest3514-21snmpd08:28:092
207679943,0cyclictest3514-21snmpd07:26:242
207679943,0cyclictest21861-21awk06:59:012
207679943,0cyclictest19340-21awk10:58:592
207679943,0cyclictest10570-21awk07:39:042
207669944,0cyclictest0-21swapper/111:41:121
207669943,0cyclictest4728-21awk07:59:021
207669943,0cyclictest3514-21snmpd09:57:101
207669943,0cyclictest3514-21snmpd09:52:401
207669943,0cyclictest3514-21snmpd09:36:401
207669943,0cyclictest3514-21snmpd09:30:251
207669943,0cyclictest3514-21snmpd08:29:541
207669943,0cyclictest3514-21snmpd08:09:391
207669943,0cyclictest3514-21snmpd07:37:391
207669943,0cyclictest3514-21snmpd07:25:391
207669943,0cyclictest3514-21snmpd07:15:391
207669943,0cyclictest3241-21irqbalance10:29:041
207669943,0cyclictest3241-21irqbalance09:23:551
207669943,0cyclictest3093-21awk11:09:031
207669943,0cyclictest27376-21awk11:04:001
207669943,0cyclictest26816-21awk11:44:011
207669943,0cyclictest25840-21awk08:39:031
207669943,0cyclictest20122-21awk09:59:011
207669943,0cyclictest19885-21awk10:19:001
207669943,0cyclictest19446-21awk10:59:001
207659944,0cyclictest19004-21diskmemload12:03:140
207659944,0cyclictest0-21swapper/010:49:080
207659944,0cyclictest0-21swapper/010:40:000
207659943,0cyclictest9557-21awk07:14:030
207659943,0cyclictest4184-21awk09:49:020
207659943,0cyclictest3556-21lldpd07:07:280
207659943,0cyclictest2700-21awk11:29:000
207659943,0cyclictest1754-21kworker/0:009:14:180
207659943,0cyclictest11204-21awk11:14:010
179940,0migration/18212-21processes10:49:101
179940,0migration/17903-21kthreadcore08:24:051
179940,0migration/128723-21kthreadcore10:44:031
179940,0migration/127936-21kthreadcore08:14:021
179940,0migration/12757-21kthreadcore08:44:031
179940,0migration/127567-21aten2.4-expect09:43:581
179940,0migration/127133-21aten_r1power_vo10:23:581
179940,0migration/126624-21rt-features06:59:071
179940,0migration/126438-21cpuspeed_turbos11:23:571
179940,0migration/120233-21kthreadcore07:44:051
179940,0migration/120229-21kthreadcore08:34:031
179940,0migration/115553-21cpuspeed_turbos07:18:591
179940,0migration/11433-21runrttasks07:06:121
179940,0migration/112100-21kthreadcore08:04:041
179940,0migration/111427-21kthreadcore07:39:051
179940,0migration/111350-21fschecks_time10:34:001
169940,0watchdog/16380-21kthreadcore09:09:051
169940,0watchdog/131186-21perl08:19:011
169940,0watchdog/130836-21sort12:04:041
169940,0watchdog/12768-21if_eth1.311:29:001
169940,0watchdog/127092-21ssh09:22:451
169940,0watchdog/126100-21ssh10:42:521
169940,0watchdog/11605-21ssh10:05:481
169940,0watchdog/10-21swapper/111:49:081
169940,0watchdog/10-21swapper/111:19:041
149940,0migration/09939-21sh09:10:550
149940,0migration/03881-21diskmemload12:09:040
149940,0migration/03741-21sh10:09:000
149940,0migration/03741-21sh10:09:000
149940,0migration/031804-21kthreadcore07:29:040
149940,0migration/030665-21kthreadcore11:44:030
149940,0migration/025804-21sh09:39:380
149940,0migration/020812-21kthreadcore07:44:050
149940,0migration/015076-21kthreadcore08:29:040
29725030,0irq/27-eth0-tx-0-21swapper/007:59:000
29715030,0irq/26-eth0-rx-0-21swapper/308:19:033
29715030,0irq/26-eth0-rx-0-21swapper/307:56:263
29715030,0irq/26-eth0-rx-0-21swapper/307:13:593
29715030,0irq/26-eth0-rx-0-21swapper/307:05:303
29715030,0irq/26-eth0-rx-0-21swapper/307:00:553
249930,0watchdog/20-21swapper/208:39:052
207669932,0cyclictest10564-21cut12:14:021
207669930,0cyclictest23057-21aten2.4-expect07:49:001
207659933,0cyclictest1754-21kworker/0:011:23:470
207659933,0cyclictest1754-21kworker/0:009:58:520
207659933,0cyclictest1754-21kworker/0:009:53:480
207659933,0cyclictest1754-21kworker/0:009:23:480
207659933,0cyclictest1754-21kworker/0:008:54:000
207659933,0cyclictest1754-21kworker/0:008:48:580
207659933,0cyclictest1754-21kworker/0:008:39:000
207659933,0cyclictest1754-21kworker/0:007:18:560
207659933,0cyclictest0-21swapper/007:38:510
179930,0migration/115107-21kthreadcore11:34:041
169930,0watchdog/10-21swapper/111:54:041
169930,0watchdog/10-21swapper/108:54:051
29715020,0irq/26-eth0-rx-0-21swapper/308:53:493
29715020,0irq/26-eth0-rx-0-21swapper/308:45:223
29715020,0irq/26-eth0-rx-0-21swapper/308:09:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional