You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 22:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue Apr 07, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2239828783,0sleep20-21swapper/207:18:452
2244427261,0sleep00-21swapper/007:19:190
2229425453,0sleep10-21swapper/107:17:361
22545994646,0cyclictest2900-21md1_resync09:11:572
2237623627,0sleep30-21swapper/307:18:303
22544992626,0cyclictest191ktimersoftd/109:11:571
8305060,0irq/26-0000:00:3957-21kthreadcore08:09:563
8305060,0irq/26-0000:00:3383-21iostat07:49:533
8305060,0irq/26-0000:00:28444-21crond08:29:373
8305060,0irq/26-0000:00:23126-21port_sshpriv07:59:563
8305060,0irq/26-0000:00:152142sleep309:04:193
35160,0ktimersoftd/30-21swapper/309:07:243
339960,0migration/329993-21sh11:20:453
339960,0migration/327126-21diskmemload11:56:093
339960,0migration/327126-21diskmemload11:56:093
339960,0migration/324767-21sh12:33:173
339960,0migration/322789-21sh09:29:483
339960,0migration/318054-21sh12:46:083
339960,0migration/313498-21sh11:13:363
29805060,0irq/28-eth0-rx-7706-21if_err_eth108:14:533
259960,0migration/214003-21latency12:24:572
225459960,0cyclictest0-21swapper/210:22:082
225449966,0cyclictest0-21swapper/108:12:461
225449960,0cyclictest0-21swapper/108:40:121
225439966,0cyclictest3524-21snmpd12:37:240
225439960,0cyclictest10792-21latency_hist11:49:370
149960,0migration/09067-21sh09:55:010
149960,0migration/027981-21sh10:07:490
149960,0migration/018596-21sh10:56:430
149960,0migration/016359-21fschecks_time09:04:490
149960,0migration/015037-21sh11:30:080
149960,0migration/014157-21aten_r1power_vo08:19:480
8305050,0irq/26-0000:00:9802-21irqrtprio10:34:522
8305050,0irq/26-0000:00:8943-21sed10:50:022
8305050,0irq/26-0000:00:6681-21sed10:14:532
8305050,0irq/26-0000:00:6074-21kthreadcore08:54:563
8305050,0irq/26-0000:00:5933-21kthreadcore08:34:553
8305050,0irq/26-0000:00:3978-21kthreadcore11:44:532
8305050,0irq/26-0000:00:3569-21ssh11:05:462
8305050,0irq/26-0000:00:32684-21ssh09:34:512
8305050,0irq/26-0000:00:32031-21python12:35:022
8305050,0irq/26-0000:00:3086-21cut12:19:552
8305050,0irq/26-0000:00:29797-21timerwakeupswit10:25:032
8305050,0irq/26-0000:00:29361-21timerwakeupswit12:15:022
8305050,0irq/26-0000:00:28144-21cut08:04:523
8305050,0irq/26-0000:00:2704-21python12:00:002
8305050,0irq/26-0000:00:26051-21df11:39:492
8305050,0irq/26-0000:00:25283-21ssh10:43:442
8305050,0irq/26-0000:00:24966-21kthreadcore07:19:533
8305050,0irq/26-0000:00:21493-21grep09:44:562
8305050,0irq/26-0000:00:20910-21perl10:04:502
8305050,0irq/26-0000:00:17972-21idleruntime11:34:522
8305050,0irq/26-0000:00:164072sleep307:56:373
8305050,0irq/26-0000:00:14648-21perl09:24:502
8305050,0irq/26-0000:00:13798-21ssh11:14:282
8305050,0irq/26-0000:00:12960-21kthreadcore09:59:542
8305050,0irq/26-0000:00:12071-21munin-node11:49:522
8305050,0irq/26-0000:00:11466-21rt-features07:29:573
8305050,0irq/26-0000:00:11287-21diskstats12:44:502
8305050,0irq/26-0000:00:11102-21latency_hist10:54:372
8305050,0irq/26-0000:00:0-21swapper/308:29:553
8305050,0irq/26-0000:00:0-21swapper/308:19:543
8305050,0irq/26-0000:00:0-21swapper/211:14:552
339950,0migration/39379-21idleruntime10:34:503
339950,0migration/3454-21kthreadcore09:14:523
339950,0migration/3376-21gltestperf10:29:513
339950,0migration/33212-21kthreadcore11:24:563
339950,0migration/328900-21cpu11:59:493
339950,0migration/328242-21munin-node07:44:513
339950,0migration/327846-21kthreadcore09:49:543
339950,0migration/325055-21kthreadcore07:39:553
339950,0migration/317766-21fschecks_time10:39:503
339950,0migration/317683-21pmu-power09:59:583
339950,0migration/314874-21kthreadcore07:34:543
339950,0migration/314718-21kthreadcore08:39:533
329950,0watchdog/33991-21ssh10:11:283
329950,0watchdog/331832-21expr11:39:563
329950,0watchdog/315883-21cut10:54:563
329950,0watchdog/314396-21aten_r1power_po10:19:483
329950,0watchdog/30-21swapper/312:19:483
29815050,0irq/29-eth0-tx-5120-21ssh12:04:492
29815050,0irq/29-eth0-tx-28206-21grep11:19:552
29815050,0irq/29-eth0-tx-19884-21munin-node11:54:562
29815050,0irq/29-eth0-tx-19884-21munin-node11:54:562
29815050,0irq/29-eth0-tx-10502-21ssh09:58:042
29815050,0irq/29-eth0-tx-0-21swapper/209:50:142
29815050,0irq/29-eth0-tx-0-21swapper/209:43:112
29805050,0irq/28-eth0-rx-9835-21ssh12:42:343
29805050,0irq/28-eth0-rx-4257-21cut11:44:533
29805050,0irq/28-eth0-rx-10902-21kthreadcore09:19:553
29805050,0irq/28-eth0-rx-10125-21cat11:29:553
29805050,0irq/28-eth0-rx-0-21swapper/312:34:563
29805050,0irq/28-eth0-rx-0-21swapper/312:24:523
29805050,0irq/28-eth0-rx-0-21swapper/312:09:593
29805050,0irq/28-eth0-rx-0-21swapper/311:54:043
29805050,0irq/28-eth0-rx-0-21swapper/311:14:503
29805050,0irq/28-eth0-rx-0-21swapper/311:06:313
29805050,0irq/28-eth0-rx-0-21swapper/310:59:543
29805050,0irq/28-eth0-rx-0-21swapper/310:24:563
29805050,0irq/28-eth0-rx-0-21swapper/309:44:563
29805050,0irq/28-eth0-rx-0-21swapper/309:35:323
259950,0migration/25795-21kthreadcore12:39:552
259950,0migration/227592-21kthreadcore10:44:562
259950,0migration/217035-21cpuspeed_turbos12:29:502
259950,0migration/214746-21fschecks_time08:19:502
249950,0watchdog/229118-21python07:19:592
225449955,0cyclictest4937-21diskmemload09:27:111
225449955,0cyclictest0-21swapper/109:32:231
225449955,0cyclictest0-21swapper/108:32:101
225449955,0cyclictest0-21swapper/108:23:011
225449955,0cyclictest0-21swapper/107:40:171
225449950,0cyclictest0-21swapper/110:30:241
225449950,0cyclictest0-21swapper/109:38:411
225439950,0cyclictest0-21swapper/012:21:570
179950,0migration/18484-21aten_r1power_po10:34:471
179950,0migration/13298-21gltestperf10:49:511
179950,0migration/126850-21taskset11:55:231
179950,0migration/126850-21taskset11:55:231
179950,0migration/126434-21fschecks_time11:39:501
179950,0migration/123858-21taskset08:02:451
179950,0migration/123789-21munin-node10:40:021
179950,0migration/114482-21munin-node08:59:591
179950,0migration/110543-21gltestperf07:54:511
169950,0watchdog/19964-21kthreadcore08:14:551
169950,0watchdog/12702-21grep08:54:551
149950,0migration/07710-21taskset11:29:140
149950,0migration/07018-21kthreadcore07:29:530
149950,0migration/06739-21irqrtprio09:19:530
149950,0migration/06468-21kthreadcore08:34:550
149950,0migration/06163-21unixbench_multi09:35:030
149950,0migration/031184-21taskset08:07:570
149950,0migration/029615-21taskset09:11:140
149950,0migration/029451-21kthreadcore09:49:550
149950,0migration/029333-21fschecks_time08:29:510
149950,0migration/027430-21kthreadcore08:49:530
149950,0migration/025050-21sh12:34:020
149950,0migration/024861-21sh09:46:570
149950,0migration/023546-21kthreadcore07:39:550
149950,0migration/020402-21kthreadcore08:44:540
149950,0migration/019396-21kthreadcore07:59:530
149950,0migration/018478-21kthreadcore11:14:550
149950,0migration/017360-21kthreadcore10:19:540
149950,0migration/015560-21missed_timers07:54:560
149950,0migration/012625-21sh12:06:510
149950,0migration/012393-21kthreadcore09:39:540
149950,0migration/011977-21gltestperf08:39:490
149950,0migration/010923-21munin-node12:44:480
8305040,0irq/26-0000:00:26903-21ssh11:00:122
8305040,0irq/26-0000:00:0-21swapper/212:09:502
8305040,0irq/26-0000:00:0-21swapper/211:29:502
339940,0migration/36694-21irqcore10:14:533
339940,0migration/35641-21kthreadcore09:54:553
329940,0watchdog/30-21swapper/312:05:483
29815040,0irq/29-eth0-tx-0-21swapper/008:11:340
29815040,0irq/29-eth0-tx-0-21swapper/007:24:510
29805040,0irq/28-eth0-rx-0-21swapper/312:15:083
29805040,0irq/28-eth0-rx-0-21swapper/311:34:553
29805040,0irq/28-eth0-rx-0-21swapper/310:49:493
29805040,0irq/28-eth0-rx-0-21swapper/310:44:483
29805040,0irq/28-eth0-rx-0-21swapper/310:04:473
29805040,0irq/28-eth0-rx-0-21swapper/309:39:543
29805040,0irq/28-eth0-rx-0-21swapper/309:24:513
29805040,0irq/28-eth0-rx-0-21swapper/309:09:373
29805040,0irq/28-eth0-rx-0-21swapper/308:48:553
259940,0migration/26244-21runrttasks08:12:472
259940,0migration/23237-21kthreadcore08:54:562
259940,0migration/229644-21kthreadcore08:49:542
259940,0migration/229006-21aten_r1power_fr10:09:482
259940,0migration/227399-21kthreadcore09:29:552
259940,0migration/224873-21kthreadcore08:24:552
259940,0migration/214091-21latency08:59:552
259940,0migration/211406-21kthreadcore07:54:542
249940,0watchdog/29966-21kthreadcore08:14:552
249940,0watchdog/26314-21runrttasks07:51:512
249940,0watchdog/22628-21mailstats08:29:592
249940,0watchdog/20-21swapper/210:29:522
249940,0watchdog/20-21swapper/208:34:552
225459943,0cyclictest6358-21awk09:19:522
225459943,0cyclictest3571-21lldpd08:45:252
225459943,0cyclictest3571-21lldpd07:29:542
225459943,0cyclictest3524-21snmpd08:43:322
225459943,0cyclictest3524-21snmpd08:06:012
225459943,0cyclictest3524-21snmpd07:28:012
225459943,0cyclictest31193-21awk09:14:492
225459943,0cyclictest18052-21awk07:59:512
225459941,0cyclictest0-21swapper/211:24:502
225459940,0cyclictest0-21swapper/207:35:012
225449944,0cyclictest0-21swapper/112:27:141
225449944,0cyclictest0-21swapper/112:08:001
225449944,0cyclictest0-21swapper/109:23:051
225449943,0cyclictest9227-21awk11:29:531
225449943,0cyclictest3571-21lldpd12:44:581
225449943,0cyclictest3524-21snmpd11:21:181
225449943,0cyclictest3524-21snmpd11:12:181
225449943,0cyclictest3524-21snmpd10:49:031
225449943,0cyclictest3524-21snmpd07:50:311
225449943,0cyclictest32663-21awk12:19:531
225449943,0cyclictest23933-21awk07:19:521
225449943,0cyclictest23756-21awk12:14:521
225439943,0cyclictest9060-21awk12:24:540
225439943,0cyclictest3571-21lldpd11:40:270
225439943,0cyclictest3571-21lldpd08:58:250
225439943,0cyclictest3524-21snmpd10:47:180
225439943,0cyclictest3442-21awk10:49:520
225439943,0cyclictest3110-21awk12:39:530
225439943,0cyclictest21034-21awk10:59:520
225439940,0cyclictest1999-21md0_raid111:11:470
179940,0migration/19083-21kthreadcore07:29:531
179940,0migration/14619-21kthreadcore11:44:531
179940,0migration/14297-21fschecks_count08:34:501
179940,0migration/14203-21kthreadcore09:54:551
179940,0migration/132564-21kthreadcore09:14:521
179940,0migration/130953-21kthreadcore09:49:551
179940,0migration/125013-21fschecks_time08:04:481
179940,0migration/123884-21switchtime09:45:031
179940,0migration/122084-21unixbench_singl09:05:021
179940,0migration/121399-21kthreadcore11:34:551
179940,0migration/120284-21df10:59:491
179940,0migration/120124-21sh10:04:441
179940,0migration/120011-21kthreadcore08:44:541
179940,0migration/114344-21kthreadcore11:49:551
179940,0migration/112097-21fschecks_time09:59:501
169940,0watchdog/132039-21grep11:04:561
169940,0watchdog/130226-21ssh10:25:481
169940,0watchdog/122302-21ssh10:23:161
169940,0watchdog/114914-21python09:40:001
169940,0watchdog/113882-21ssh12:09:441
169940,0watchdog/10-21swapper/112:35:521
169940,0watchdog/10-21swapper/111:59:561
169940,0watchdog/10-21swapper/111:14:401
169940,0watchdog/10-21swapper/110:54:561
149940,0migration/06752-21runrttasks10:30:560
149940,0migration/030303-21runrttasks11:21:380
149940,0migration/027056-21kthreadcore10:24:550
149940,0migration/026226-21kthreadcore12:14:540
149940,0migration/016805-21kthreadcore11:49:560
149940,0migration/010648-21kthreadcore08:59:540
8305030,0irq/26-0000:00:0-21swapper/308:49:423
29815030,0irq/29-eth0-tx-2294-21aten2.4-expect07:49:490
29815030,0irq/29-eth0-tx-0-21swapper/008:24:490
29815030,0irq/29-eth0-tx-0-21swapper/007:44:470
29815030,0irq/29-eth0-tx-0-21swapper/007:19:470
29805030,0irq/28-eth0-rx-0-21swapper/307:24:473
225459933,0cyclictest0-21swapper/207:39:542
225459932,0cyclictest16533-21awk09:04:512
225449932,0cyclictest6618-21awk10:14:521
225449932,0cyclictest4439-21vmstat07:25:031
225449932,0cyclictest28213-21awk07:44:501
225449932,0cyclictest2798-21ntp_offset10:09:571
225449932,0cyclictest22563-21irqcore08:24:541
225449930,0cyclictest26967-21sh08:49:521
225439932,0cyclictest9105-21cut10:14:540
225439932,0cyclictest4219-21ssh12:03:040
225439932,0cyclictest31208-21awk09:14:500
225439932,0cyclictest29882-21awk11:04:540
225439932,0cyclictest23876-21awk09:29:520
225439932,0cyclictest20057-21cut11:34:550
225439932,0cyclictest17815-21sensors09:59:590
225439932,0cyclictest15818-21kthreadcore09:24:540
225439932,0cyclictest13553-21awk07:34:520
225439930,0cyclictest22190-21runrttasks12:14:050
225439930,0cyclictest20628-21perl11:54:510
225439930,0cyclictest20628-21perl11:54:510
225439930,0cyclictest19983-21grep10:39:540
179930,0migration/122651-21kthreadcore12:29:561
169930,0watchdog/113492-21munin-node07:34:511
169930,0watchdog/10-21swapper/112:40:201
169930,0watchdog/10-21swapper/111:24:561
249920,0watchdog/20-21swapper/207:44:432
225439921,0cyclictest6773-21basename08:14:490
225439921,0cyclictest28779-21sed10:09:360
225439920,0cyclictest0-21swapper/010:34:400
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional