You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 16:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Sun Jul 26, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1958224435,0sleep20-21swapper/207:28:122
1951824342,0sleep10-21swapper/107:27:271
1950323223,0sleep30-21swapper/307:27:173
1935322925,0sleep00-21swapper/007:25:340
339970,0migration/326835-21sh11:37:593
339970,0migration/320658-21munin-node08:58:503
8305060,0irq/26-0000:00:32110-21date11:03:382
8305060,0irq/26-0000:00:12753-21crond08:08:373
35160,0ktimersoftd/30-21swapper/312:40:523
35160,0ktimersoftd/30-21swapper/312:22:543
35160,0ktimersoftd/30-21swapper/310:24:213
339960,0migration/39537-21munin-node08:28:503
339960,0migration/36075-21sh09:30:563
339960,0migration/330705-21sh10:59:543
339960,0migration/330457-21sh12:34:053
339960,0migration/329043-21sh10:40:173
339960,0migration/328764-21timerandwakeup12:14:033
339960,0migration/327948-21sh10:22:253
339960,0migration/316649-21sh12:47:193
339960,0migration/31169-21kthreadcore10:44:013
29805060,0irq/28-eth0-rx-2342-21iostat_ios09:48:573
29805060,0irq/28-eth0-rx-21554-21kthreadcore12:48:563
196939960,0cyclictest0-21swapper/112:42:571
196929960,0cyclictest12555-21hwlatdetect10:13:530
149960,0migration/013330-21runrttasks10:49:050
8305050,0irq/26-0000:00:0-21swapper/308:23:373
339950,0migration/39100-21taskset09:10:383
339950,0migration/39091-21kthreadcore09:33:563
339950,0migration/3874-21kthreadcore07:58:563
339950,0migration/38531-21aten_r1power_cu11:08:503
339950,0migration/37138-21kthreadcore07:38:573
339950,0migration/330863-21munin-node09:44:003
339950,0migration/327156-21sh07:33:493
339950,0migration/327141-21munin-node10:03:513
339950,0migration/324258-21fschecks_count07:53:513
339950,0migration/320884-21sh12:10:103
339950,0migration/320579-21df_abs08:13:523
339950,0migration/32018-21munin-node11:23:513
339950,0migration/319147-21kthreadcore09:18:563
339950,0migration/314399-21runrttasks10:52:043
339950,0migration/312693-21taskset08:51:253
339950,0migration/312550-21fschecks_count11:48:523
339950,0migration/311507-21taskset10:13:433
329950,0watchdog/35175-21kthreadcore08:23:573
329950,0watchdog/330732-21kthreadcore11:18:573
329950,0watchdog/323680-21sh09:41:293
329950,0watchdog/312731-21kthreadcore12:23:583
329950,0watchdog/310701-21df_abs11:28:533
29815050,0irq/29-eth0-tx-9204-21munin-node07:43:540
29815050,0irq/29-eth0-tx-32630-21munin-node12:38:542
29815050,0irq/29-eth0-tx-24452-21df12:33:532
29815050,0irq/29-eth0-tx-23934-21kthreadcore09:58:582
29815050,0irq/29-eth0-tx-17863-21perl11:13:542
29815050,0irq/29-eth0-tx-1104-21proc_pri11:39:002
29815050,0irq/29-eth0-tx-11005-21ssh11:46:282
29815050,0irq/29-eth0-tx-0-21swapper/212:56:322
29815050,0irq/29-eth0-tx-0-21swapper/212:26:442
29815050,0irq/29-eth0-tx-0-21swapper/209:55:502
29815050,0irq/29-eth0-tx-0-21swapper/007:54:020
29805050,0irq/28-eth0-rx-32625-21df_abs11:03:503
29805050,0irq/28-eth0-rx-26830-21perl12:53:543
29805050,0irq/28-eth0-rx-23107-21cut09:58:583
29805050,0irq/28-eth0-rx-19918-21kthreadcore08:33:563
29805050,0irq/28-eth0-rx-0-21swapper/311:58:513
29805050,0irq/28-eth0-rx-0-21swapper/311:38:563
29805050,0irq/28-eth0-rx-0-21swapper/310:29:003
259950,0migration/24283-21kthreadcore08:43:572
259950,0migration/231743-21irqcore10:44:002
259950,0migration/229645-21hwlatdetect10:23:542
259950,0migration/229092-21sh12:14:212
259950,0migration/226476-21gltestperf11:18:532
259950,0migration/223254-21unixbench_multi09:19:052
259950,0migration/222901-21gltestperf10:38:522
259950,0migration/221456-21kernelversion07:28:552
259950,0migration/221456-21kernelversion07:28:552
259950,0migration/218578-21latency_hist11:33:382
259950,0migration/218025-21kthreadcore10:53:572
259950,0migration/216874-21sh12:47:582
259950,0migration/214492-21sh10:52:222
259950,0migration/211721-21kthreadcore08:28:552
259950,0migration/21145-21kthreadcore11:58:592
196949955,0cyclictest0-21swapper/209:40:532
196949950,0cyclictest0-21swapper/212:53:332
196949950,0cyclictest0-21swapper/211:25:342
196949950,0cyclictest0-21swapper/210:29:552
196949950,0cyclictest0-21swapper/209:34:442
196939950,0cyclictest0-21swapper/111:49:301
196939950,0cyclictest0-21swapper/111:30:351
196939950,0cyclictest0-21swapper/110:36:111
196939950,0cyclictest0-21swapper/110:24:131
196929955,0cyclictest0-21swapper/012:19:230
196929950,0cyclictest0-21swapper/012:50:270
196929950,0cyclictest0-21swapper/012:26:100
196929950,0cyclictest0-21swapper/010:25:330
196929950,0cyclictest0-21swapper/010:06:290
196929950,0cyclictest0-21swapper/008:29:310
179950,0migration/1842-21idleruntime11:03:521
179950,0migration/130118-21taskset10:43:301
179950,0migration/128740-21timerandwakeup12:14:031
179950,0migration/127835-21kthreadcore09:23:541
179950,0migration/126565-21latency_hist10:03:381
179950,0migration/123599-21pmu-power12:48:591
179950,0migration/116149-21ksmtuned08:30:391
179950,0migration/115641-21munin-node09:14:041
179950,0migration/11123-21sendmail_mailst08:19:001
169950,0watchdog/123443-21kthreadcore11:53:581
169950,0watchdog/112728-21cut09:33:571
149950,0migration/08868-21taskset12:43:490
149950,0migration/05924-21kthreadcore09:48:590
149950,0migration/05396-21aten_r1power_po12:03:510
149950,0migration/05163-21kthreadcore10:08:560
149950,0migration/05029-21sh10:44:370
149950,0migration/04379-21taskset12:01:530
149950,0migration/04260-21kthreadcore11:23:560
149950,0migration/032271-21idleruntime09:28:570
149950,0migration/032022-21munin-node12:54:000
149950,0migration/027256-21kthreadcore09:43:570
149950,0migration/027068-21timerandwakeup11:54:050
149950,0migration/024012-21aten_r1power_cu09:23:470
149950,0migration/023365-21smart_sdb11:14:050
149950,0migration/022015-21kthreadcore08:13:570
149950,0migration/021799-21kthreadcore09:58:570
149950,0migration/021446-21taskset10:38:000
149950,0migration/02091-21idleruntime-cro09:08:380
149950,0migration/013096-21latency_hist08:53:380
8305040,0irq/26-0000:00:0-21swapper/210:08:382
8305040,0irq/26-0000:00:0-21swapper/209:48:382
339940,0migration/324580-21fschecks_count09:23:503
339940,0migration/319848-21taskset08:12:383
339940,0migration/317348-21diskmemload11:13:533
339940,0migration/316419-21kthreadcore08:53:563
329940,0watchdog/323444-21kthreadcore11:53:583
329940,0watchdog/316560-21idleruntime12:28:543
329940,0watchdog/30-21swapper/311:44:383
329940,0watchdog/30-21swapper/308:43:573
329940,0watchdog/30-21swapper/307:32:373
329940,0watchdog/30-21swapper/307:32:373
29815040,0irq/29-eth0-tx-1230-21ssh10:04:262
29815040,0irq/29-eth0-tx-0-21swapper/212:18:522
29815040,0irq/29-eth0-tx-0-21swapper/212:08:522
29815040,0irq/29-eth0-tx-0-21swapper/211:48:442
29815040,0irq/29-eth0-tx-0-21swapper/211:34:012
29815040,0irq/29-eth0-tx-0-21swapper/210:33:502
29815040,0irq/29-eth0-tx-0-21swapper/210:19:192
29815040,0irq/29-eth0-tx-0-21swapper/008:43:500
29815040,0irq/29-eth0-tx-0-21swapper/008:38:490
29815040,0irq/29-eth0-tx-0-21swapper/008:23:520
29815040,0irq/29-eth0-tx-0-21swapper/007:58:510
29815040,0irq/29-eth0-tx-0-21swapper/007:39:000
29815040,0irq/29-eth0-tx-0-21swapper/007:28:500
29815040,0irq/29-eth0-tx-0-21swapper/007:28:500
29805040,0irq/28-eth0-rx-11655-21kthreadcore09:13:593
29805040,0irq/28-eth0-rx-0-21swapper/312:03:543
29805040,0irq/28-eth0-rx-0-21swapper/310:53:573
29805040,0irq/28-eth0-rx-0-21swapper/310:35:003
29805040,0irq/28-eth0-rx-0-21swapper/310:08:553
29805040,0irq/28-eth0-rx-0-21swapper/309:56:173
259940,0migration/28856-21kthreadcore12:03:572
259940,0migration/24089-21kthreadcore08:23:572
259940,0migration/232608-21kthreadcore08:18:562
259940,0migration/228105-21hwlatdetect07:33:522
259940,0migration/226233-21kthreadcore08:38:552
259940,0migration/225611-21fschecks_time09:43:542
259940,0migration/22322-21kthreadcore11:03:542
259940,0migration/211714-21cpu10:13:512
259940,0migration/210888-21kthreadcore08:48:582
249940,0watchdog/223688-21aten_r1power_cu07:53:492
249940,0watchdog/20-21swapper/212:28:542
249940,0watchdog/20-21swapper/209:23:492
196949943,0cyclictest9567-21awk11:08:542
196949943,0cyclictest6870-21awk08:03:522
196949943,0cyclictest3571-21lldpd07:47:442
196949943,0cyclictest32410-21awk09:28:582
196949943,0cyclictest2983-21awk07:38:542
196949943,0cyclictest17775-21awk08:33:542
196949943,0cyclictest14127-21awk08:08:542
196949943,0cyclictest10672-21awk09:13:572
196949943,0cyclictest0-21swapper/211:53:572
196939943,0cyclictest3571-21lldpd11:19:451
196939943,0cyclictest3524-21snmpd11:36:091
196939943,0cyclictest32157-21awk08:43:551
196939943,0cyclictest31564-21awk10:43:591
196939943,0cyclictest27087-21awk12:53:561
196939943,0cyclictest25313-21awk12:33:571
196939943,0cyclictest21412-21awk08:58:531
196929944,0cyclictest0-21swapper/012:33:440
196929943,0cyclictest9582-21awk11:08:540
196929943,0cyclictest3571-21lldpd12:31:150
196929943,0cyclictest3524-21snmpd08:58:520
196929943,0cyclictest3250-21irqbalance12:15:150
196929943,0cyclictest3250-21irqbalance10:53:450
196929943,0cyclictest3250-21irqbalance09:56:050
196929943,0cyclictest3250-21irqbalance09:38:540
196929943,0cyclictest3250-21irqbalance09:34:540
196929943,0cyclictest3250-21irqbalance07:50:540
196929943,0cyclictest28492-21awk11:38:550
196929943,0cyclictest24792-21awk10:58:550
196929943,0cyclictest14033-21awk08:08:530
196929943,0cyclictest1283-21awk12:38:540
196929943,0cyclictest11514-21awk11:28:570
196929943,0cyclictest10002-21df09:13:540
179940,0migration/19153-21taskset09:11:121
179940,0migration/17188-21fschecks_count10:48:531
179940,0migration/17125-21kthreadcore08:23:571
179940,0migration/15529-21cpuspeed_turbos12:03:511
179940,0migration/1487-21kthreadcore09:29:001
179940,0migration/14084-21fschecks_count11:43:521
179940,0migration/131984-21kthreadcore07:33:561
179940,0migration/126182-21switchtime07:29:021
179940,0migration/126182-21switchtime07:29:021
179940,0migration/126089-21missed_timers10:18:581
179940,0migration/12607-21fschecks_time07:38:521
179940,0migration/12589-21sh10:08:251
179940,0migration/122838-21munin-node08:34:011
179940,0migration/120092-21crond08:58:371
179940,0migration/119969-21kthreadcore09:18:561
179940,0migration/119478-21kthreadcore07:48:531
179940,0migration/116372-21unixbench_multi09:54:041
179940,0migration/114017-21idleruntime08:08:531
179940,0migration/112783-21ksmtuned10:32:401
179940,0migration/111207-21kthreadcore12:23:571
169940,0watchdog/12961-21ssh10:08:491
169940,0watchdog/124664-21grep10:58:531
169940,0watchdog/123687-21aten_r1power_cu07:53:491
169940,0watchdog/119434-21kthreadcore10:53:571
169940,0watchdog/114826-21sensors11:09:011
169940,0watchdog/10-21swapper/112:18:581
169940,0watchdog/10-21swapper/112:08:581
149940,0migration/09010-21taskset09:09:350
149940,0migration/08972-21kthreadcore11:43:570
149940,0migration/029520-21kthreadcore07:33:550
149940,0migration/028802-21kthreadcore11:18:570
149940,0migration/026475-21taskset10:19:050
149940,0migration/023199-21timerwakeupswit09:19:050
149940,0migration/020743-21kthreadcore08:33:560
149940,0migration/011074-21kthreadcore08:03:550
8305030,0irq/26-0000:00:0-21swapper/209:04:132
339930,0migration/329266-21kthreadcore08:38:563
329930,0watchdog/30-21swapper/309:05:053
329930,0watchdog/30-21swapper/307:43:413
29815030,0irq/29-eth0-tx-0-21swapper/008:18:500
29805030,0irq/28-eth0-rx-0-21swapper/307:48:483
259930,0migration/224980-21kthreadcore08:58:562
249930,0watchdog/20-21swapper/207:48:492
196949932,0cyclictest4130-21cut09:08:552
196949932,0cyclictest3571-21lldpd08:57:452
196949932,0cyclictest3524-21snmpd08:00:522
196949932,0cyclictest21244-21awk08:13:552
196939932,0cyclictest987-21ntp_offset11:38:591
196939932,0cyclictest6982-21awk08:48:561
196939932,0cyclictest3524-21snmpd07:47:521
196939932,0cyclictest31124-21sensors09:44:031
196939932,0cyclictest24881-21awk08:38:531
196939932,0cyclictest18068-21awk11:13:561
196939932,0cyclictest12673-21awk10:13:541
196939932,0cyclictest10046-21awk12:43:561
196939930,0cyclictest6152-21diskstats08:03:491
196939930,0cyclictest16401-21perl12:28:521
196929932,0cyclictest3524-21snmpd11:36:260
196929932,0cyclictest3524-21snmpd08:50:570
196929932,0cyclictest23156-21awk10:38:550
196929932,0cyclictest13138-21awk11:48:540
196929932,0cyclictest1037-21awk11:03:530
196929930,0cyclictest5646-21grep10:28:510
196929930,0cyclictest14711-21perl12:08:540
179930,0migration/11638-21sh11:23:411
169930,0watchdog/10-21swapper/111:59:021
169930,0watchdog/10-21swapper/109:48:411
169930,0watchdog/10-21swapper/109:38:491
169930,0watchdog/10-21swapper/109:03:411
169930,0watchdog/10-21swapper/107:58:571
169920,0watchdog/10-21swapper/108:13:411
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional