You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 16:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Sat Aug 15, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450450,0irq/25-eth10-21swapper/306:43:363
302823425,0sleep20-21swapper/206:44:532
296523423,0sleep00-21swapper/006:44:060
288023323,0sleep10-21swapper/106:43:071
339960,0migration/3900-21taskset09:05:403
339960,0migration/33783-21sh12:09:583
339960,0migration/332249-21munin-node10:47:023
339960,0migration/330916-21sh10:46:053
32789960,0cyclictest0-21swapper/210:09:262
32779966,0cyclictest0-21swapper/111:30:351
32779960,0cyclictest0-21swapper/111:33:251
32779960,0cyclictest0-21swapper/110:39:301
32769960,0cyclictest0-21swapper/011:11:590
29725060,0irq/27-eth0-tx-0-21swapper/211:40:152
29715060,0irq/26-eth0-rx-8613-21sed10:32:023
29715060,0irq/26-eth0-rx-8553-21irqrtprio08:27:033
29715060,0irq/26-eth0-rx-10273-21open_files12:12:083
149960,0migration/04754-21sh11:29:120
149960,0migration/032188-21gltestperf10:47:010
149960,0migration/016608-21sh08:54:210
149960,0migration/012583-21sh11:55:440
339950,0migration/36066-21fschecks_time07:37:013
339950,0migration/35702-21kthreadcore09:47:043
339950,0migration/35351-21kthreadcore08:22:053
339950,0migration/33685-21munin-node06:46:593
339950,0migration/33587-21kthreadcore10:27:053
339950,0migration/33205-21kthreadcore11:27:053
339950,0migration/330804-21taskset11:06:543
339950,0migration/329124-21taskset11:02:293
339950,0migration/327946-21kthreadcore07:27:063
339950,0migration/326795-21munin-node12:02:073
339950,0migration/324446-21kthreadcore08:37:043
339950,0migration/320100-21runrttasks11:37:413
339950,0migration/319434-21kthreadcore09:17:053
339950,0migration/319234-21taskset08:08:273
339950,0migration/318432-21fschecks_time08:57:003
339950,0migration/318308-21kthreadcore11:57:053
339950,0migration/316050-21fschecks_time10:36:593
339950,0migration/311364-21kthreadcore10:52:043
32789955,0cyclictest0-21swapper/210:58:092
32789955,0cyclictest0-21swapper/210:22:412
32789955,0cyclictest0-21swapper/209:39:382
32789955,0cyclictest0-21swapper/209:08:442
32789950,0cyclictest0-21swapper/211:55:512
32789950,0cyclictest0-21swapper/211:36:372
32789950,0cyclictest0-21swapper/211:24:292
32789950,0cyclictest0-21swapper/210:14:572
32789950,0cyclictest0-21swapper/208:54:332
32789950,0cyclictest0-21swapper/208:22:042
32779955,0cyclictest0-21swapper/111:37:411
32779955,0cyclictest0-21swapper/111:15:271
32779955,0cyclictest0-21swapper/110:35:341
32779955,0cyclictest0-21swapper/109:41:101
32779955,0cyclictest0-21swapper/107:37:061
32779954,0cyclictest8188-21wc08:27:011
32779954,0cyclictest3241-21irqbalance07:49:261
32779950,0cyclictest0-21swapper/112:14:341
32779950,0cyclictest0-21swapper/110:56:221
32779950,0cyclictest0-21swapper/108:53:521
32779950,0cyclictest0-21swapper/108:14:181
32779950,0cyclictest0-21swapper/107:06:591
32769950,0cyclictest0-21swapper/011:33:450
29725050,0irq/27-eth0-tx-30267-21munin-node11:27:082
29725050,0irq/27-eth0-tx-17799-21munin-node07:22:100
29725050,0irq/27-eth0-tx-13132-21munin-node08:07:080
29725050,0irq/27-eth0-tx-0-21swapper/007:07:070
29715050,0irq/26-eth0-rx-8423-21kthreadcore11:52:043
29715050,0irq/26-eth0-rx-7332-21munin-node08:02:033
29715050,0irq/26-eth0-rx-4311-21grep09:07:063
29715050,0irq/26-eth0-rx-31905-21perf07:56:473
29715050,0irq/26-eth0-rx-30070-21unixbench_singl10:22:103
29715050,0irq/26-eth0-rx-27821-21needreboot11:22:073
29715050,0irq/26-eth0-rx-17451-21ssh08:56:443
29715050,0irq/26-eth0-rx-0-21swapper/311:43:173
29715050,0irq/26-eth0-rx-0-21swapper/311:17:313
29715050,0irq/26-eth0-rx-0-21swapper/311:01:113
29715050,0irq/26-eth0-rx-0-21swapper/310:14:323
29715050,0irq/26-eth0-rx-0-21swapper/309:38:473
29715050,0irq/26-eth0-rx-0-21swapper/309:12:053
29715050,0irq/26-eth0-rx-0-21swapper/308:49:173
29715050,0irq/26-eth0-rx-0-21swapper/307:57:033
179950,0migration/17273-21munin-node09:07:081
179950,0migration/16916-21ntp_offset09:27:071
179950,0migration/16246-21munin-node11:52:021
179950,0migration/126450-21kthreadcore11:02:041
179950,0migration/115775-21idleruntime10:57:011
179950,0migration/112452-21kthreadcore09:32:051
169950,0watchdog/119928-21kthreadcore09:17:051
149950,0migration/08307-21sh09:51:230
149950,0migration/08205-21idleruntime08:27:020
149950,0migration/0794-21timerwakeupswit08:42:090
149950,0migration/06379-21kthreadcore08:47:050
149950,0migration/032555-21fschecks_time10:27:010
149950,0migration/031499-21kthreadcore12:07:040
149950,0migration/030013-21needreboot10:02:050
149950,0migration/029965-21sh11:26:440
149950,0migration/027134-21kthreadcore07:02:050
149950,0migration/026591-21kthreadcore10:42:040
149950,0migration/026280-21fschecks_count09:22:010
149950,0migration/023655-21kthreadcore08:37:040
149950,0migration/022719-21munin-node11:42:020
149950,0migration/022004-21taskset10:38:080
149950,0migration/020974-21latency_hist12:01:470
149950,0migration/019678-21timerandwakeup11:37:100
149950,0migration/017650-21kthreadcore08:32:050
149950,0migration/017626-21munin-node09:57:040
149950,0migration/017402-21kthreadcore11:17:040
149950,0migration/016871-21aten_r1power_cu06:56:590
149950,0migration/015706-21gltestperf10:57:010
149950,0migration/014297-21kthreadcore09:12:050
149950,0migration/012179-21irqcore07:17:030
149950,0migration/010635-21fschecks_count06:52:010
149950,0migration/010364-21kthreadcore08:02:060
8215040,0irq/24-0000:00:29409-21latency_hist11:46:472
339940,0migration/33985-21diskmemload11:48:473
339940,0migration/321647-21kthreadcore08:12:053
339940,0migration/315228-21kthreadcore07:42:053
339940,0migration/310631-21runrttasks07:13:423
32789943,0cyclictest9589-21awk09:52:022
32789943,0cyclictest8426-21awk10:32:012
32789943,0cyclictest3556-21lldpd08:47:302
32789943,0cyclictest3556-21lldpd08:34:002
32789943,0cyclictest3556-21lldpd07:31:302
32789943,0cyclictest3556-21lldpd07:00:302
32789943,0cyclictest3514-21snmpd11:11:082
32789943,0cyclictest3514-21snmpd09:47:382
32789943,0cyclictest3514-21snmpd07:52:072
32789943,0cyclictest3514-21snmpd07:37:222
32789943,0cyclictest3241-21irqbalance10:51:552
32789943,0cyclictest3241-21irqbalance09:21:562
32789943,0cyclictest3241-21irqbalance09:12:162
32789943,0cyclictest3241-21irqbalance07:56:562
32789943,0cyclictest24339-21awk07:02:022
32789943,0cyclictest21562-21awk08:37:012
32789943,0cyclictest2108-21awk09:27:022
32789943,0cyclictest18673-21awk09:17:032
32789943,0cyclictest13971-21awk08:07:022
32779944,0cyclictest0-21swapper/109:43:231
32779944,0cyclictest0-21swapper/108:57:581
32779944,0cyclictest0-21swapper/107:44:211
32779943,0cyclictest526-21awk07:57:031
32779943,0cyclictest3556-21lldpd08:32:301
32779943,0cyclictest27353-21awk08:17:031
32779943,0cyclictest26628-21awk09:22:021
32779943,0cyclictest24958-21awk10:22:021
32779943,0cyclictest24434-21awk07:02:031
32779943,0cyclictest22671-21awk11:42:011
32779943,0cyclictest22137-21awk12:02:021
32779943,0cyclictest11054-21awk06:52:031
32779943,0cyclictest10767-21awk09:12:021
32779943,0cyclictest1054-21grep08:22:011
32779940,0cyclictest0-21swapper/108:06:441
32779940,0cyclictest0-21swapper/107:28:161
32779940,0cyclictest0-21swapper/106:46:571
32769944,0cyclictest0-21swapper/011:49:310
32769943,0cyclictest3556-21lldpd10:07:010
32769943,0cyclictest3514-21snmpd12:13:080
32769943,0cyclictest3514-21snmpd07:56:070
32769943,0cyclictest3241-21irqbalance09:52:150
32769943,0cyclictest3241-21irqbalance09:32:160
32769943,0cyclictest3241-21irqbalance08:57:060
32769943,0cyclictest3241-21irqbalance07:46:560
32769943,0cyclictest3241-21irqbalance07:42:060
32769943,0cyclictest3241-21irqbalance07:37:160
32769943,0cyclictest3241-21irqbalance07:12:160
32769943,0cyclictest25438-21awk07:27:040
32769943,0cyclictest23859-21awk11:02:020
32769943,0cyclictest20646-21awk08:12:030
32769940,0cyclictest0-21swapper/010:20:350
32769940,0cyclictest0-21swapper/009:37:220
32769940,0cyclictest0-21swapper/009:21:280
29725040,0irq/27-eth0-tx-25940-21munin-node09:02:112
29725040,0irq/27-eth0-tx-24194-21ssh08:57:492
29725040,0irq/27-eth0-tx-24154-21irqstats11:02:032
29725040,0irq/27-eth0-tx-23261-21ssh12:02:032
29725040,0irq/27-eth0-tx-19422-21ssh11:57:192
29725040,0irq/27-eth0-tx-15445-21ssh10:36:512
29725040,0irq/27-eth0-tx-1397-21diskmemload12:07:362
29725040,0irq/27-eth0-tx-1397-21diskmemload11:12:102
29725040,0irq/27-eth0-tx-1397-21diskmemload10:16:512
29725040,0irq/27-eth0-tx-0-21swapper/211:41:572
29725040,0irq/27-eth0-tx-0-21swapper/211:16:592
29725040,0irq/27-eth0-tx-0-21swapper/210:47:102
29725040,0irq/27-eth0-tx-0-21swapper/210:27:032
29725040,0irq/27-eth0-tx-0-21swapper/210:01:572
29725040,0irq/27-eth0-tx-0-21swapper/008:22:000
29725040,0irq/27-eth0-tx-0-21swapper/008:17:000
29725040,0irq/27-eth0-tx-0-21swapper/007:57:000
29725040,0irq/27-eth0-tx-0-21swapper/007:32:020
29715040,0irq/26-eth0-rx-14755-21gltestperf08:32:013
29715040,0irq/26-eth0-rx-1412-21kthreadcore07:07:053
29715040,0irq/26-eth0-rx-10341-21kthreadcore11:32:043
29715040,0irq/26-eth0-rx-0-21swapper/311:12:003
29715040,0irq/26-eth0-rx-0-21swapper/310:17:003
29715040,0irq/26-eth0-rx-0-21swapper/310:06:493
29715040,0irq/26-eth0-rx-0-21swapper/310:02:043
29715040,0irq/26-eth0-rx-0-21swapper/309:57:443
29715040,0irq/26-eth0-rx-0-21swapper/309:52:063
29715040,0irq/26-eth0-rx-0-21swapper/309:42:423
29715040,0irq/26-eth0-rx-0-21swapper/309:31:593
29715040,0irq/26-eth0-rx-0-21swapper/309:27:523
29715040,0irq/26-eth0-rx-0-21swapper/309:25:143
29715040,0irq/26-eth0-rx-0-21swapper/308:16:483
29715040,0irq/26-eth0-rx-0-21swapper/306:54:493
259940,0migration/29438-21kthreadcore07:12:062
259940,0migration/25168-21kthreadcore06:47:042
259940,0migration/2420-21kthreadcore07:07:052
259940,0migration/231919-21kthreadcore08:42:042
259940,0migration/225297-21kthreadcore10:42:032
259940,0migration/225102-21sh09:41:482
259940,0migration/223942-21kthreadcore07:47:052
249940,0watchdog/215331-21cut06:52:062
249940,0watchdog/210787-21kthreadcore08:02:062
249940,0watchdog/20-21swapper/212:12:052
249940,0watchdog/20-21swapper/209:57:052
249940,0watchdog/20-21swapper/209:32:052
249940,0watchdog/20-21swapper/208:12:062
249940,0watchdog/20-21swapper/207:42:062
179940,0migration/15293-21kthreadcore09:47:041
179940,0migration/14004-21needreboot11:07:061
179940,0migration/132192-21kthreadcore12:07:041
179940,0migration/127866-21kthreadcore07:52:051
179940,0migration/127030-21kthreadcore10:02:041
179940,0migration/12496-21kthreadcore07:32:051
179940,0migration/122718-21df_abs11:22:001
179940,0migration/120375-21kthreadcore09:57:061
179940,0migration/116528-21fschecks_count10:17:001
179940,0migration/115321-21munin-node11:17:021
179940,0migration/112357-21irqrtprio07:17:031
169940,0watchdog/13842-21cut10:47:051
169940,0watchdog/132436-21expr10:27:011
169940,0watchdog/130101-21forks11:47:011
169940,0watchdog/117545-21perl06:57:021
169940,0watchdog/116088-21kthreadcore11:57:051
169940,0watchdog/115604-21ssh09:54:331
169940,0watchdog/113306-21kthreadcore10:12:051
169940,0watchdog/10-21swapper/109:02:051
169940,0watchdog/10-21swapper/108:47:061
149940,0migration/07699-21sh09:27:490
149940,0migration/027445-21kthreadcore09:42:040
149940,0migration/026868-21if_eth009:02:040
149940,0migration/02161-21fschecks_count09:07:020
149940,0migration/010063-21kthreadcore10:32:030
32789932,0cyclictest3514-21snmpd07:17:372
32789932,0cyclictest32002-21awk07:32:022
32789932,0cyclictest13110-21wc08:27:092
32779932,0cyclictest5767-21uname07:12:051
32779932,0cyclictest3356-21tr10:07:041
32779932,0cyclictest29270-21sensors10:42:081
32779932,0cyclictest28329-21awk08:42:021
32769933,0cyclictest23239-21kworker/0:211:06:480
32769933,0cyclictest23239-21kworker/0:210:51:540
32769933,0cyclictest23239-21kworker/0:210:11:480
32769933,0cyclictest23239-21kworker/0:206:46:510
32769933,0cyclictest22045-21awk12:02:010
32769932,0cyclictest3241-21irqbalance10:21:550
29715030,0irq/26-eth0-rx-0-21swapper/308:41:583
29715030,0irq/26-eth0-rx-0-21swapper/307:46:593
29715030,0irq/26-eth0-rx-0-21swapper/307:31:593
29715030,0irq/26-eth0-rx-0-21swapper/307:21:593
29715030,0irq/26-eth0-rx-0-21swapper/307:18:203
29715030,0irq/26-eth0-rx-0-21swapper/307:05:033
249930,0watchdog/230817-21cut08:17:062
249930,0watchdog/20-21swapper/207:22:102
179930,0migration/124064-21kthreadcore08:37:041
169930,0watchdog/10-21swapper/107:22:101
32779920,0cyclictest12895-21latency_hist08:06:471
29715020,0irq/26-eth0-rx-0-21swapper/306:56:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional