You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 13:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Mon Jul 13, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
697125041,0sleep20-21swapper/207:26:482
685123625,0sleep10-21swapper/107:25:231
669623525,0sleep30-21swapper/307:23:403
3243723127,0sleep00-21swapper/007:22:450
71099973,0cyclictest3524-21snmpd09:58:162
71099973,0cyclictest21182-21awk10:42:512
71099973,0cyclictest13662-21munin-node10:57:442
71099973,0cyclictest12301-21awk08:37:502
71099972,0cyclictest6196-21awk10:52:502
71099970,0cyclictest9004-21munin-node10:17:482
71099970,0cyclictest6240-21ssh11:10:292
71099970,0cyclictest3688-21idleruntime10:32:522
71099970,0cyclictest27218-21munin-node09:32:492
8305060,0irq/26-0000:00:3207-17auditd12:57:353
8305060,0irq/26-0000:00:31932-21vmstat12:38:013
71099964,0cyclictest0-21swapper/211:04:392
71099964,0cyclictest0-21swapper/210:07:542
71099963,0cyclictest3571-21lldpd08:51:232
71099962,0cyclictest8280-21kthreadcore08:32:542
71099962,0cyclictest4788-21awk09:37:502
71099962,0cyclictest3571-21lldpd12:10:252
71099962,0cyclictest32664-21awk12:22:552
71099962,0cyclictest25487-21kthreadcore12:17:512
71099962,0cyclictest2008-21iostat11:27:492
71099962,0cyclictest15318-21munin-node10:02:542
71099961,0cyclictest15729-21awk07:32:522
71099961,0cyclictest0-21swapper/210:12:482
71099960,0cyclictest9848-21grep11:32:482
71099960,0cyclictest9214-21tr11:12:522
71099960,0cyclictest8470-21cut12:27:492
71099960,0cyclictest7463-21aten_r1power_vo07:27:452
71099960,0cyclictest4044-21tune2fs11:47:492
71099960,0cyclictest3767-21idleruntime-cro08:32:342
71099960,0cyclictest28998-21cut11:22:522
71099960,0cyclictest28079-21sshd11:42:512
71099960,0cyclictest25392-21kthreadcore09:07:522
71099960,0cyclictest25136-21port_sshpriv12:52:572
71099960,0cyclictest22719-21perl08:22:492
71099960,0cyclictest21894-21cut12:32:542
71099960,0cyclictest21886-21df_abs09:47:472
71099960,0cyclictest20595-21munin-node11:57:562
71099960,0cyclictest18653-21munin-node09:27:542
71099960,0cyclictest18451-21cut11:17:522
71099960,0cyclictest18264-21grep09:42:532
71099960,0cyclictest18044-21munin-run07:57:342
71099960,0cyclictest14235-21munin-node12:12:492
71099960,0cyclictest13388-21ps11:52:502
71099960,0cyclictest1316-21kthreadcore10:47:522
71099960,0cyclictest12646-21iostat_ios09:22:512
71099960,0cyclictest12379-21ls10:37:492
71099960,0cyclictest11263-21grep12:47:512
71099960,0cyclictest0-21swapper/210:27:512
71079960,0cyclictest0-21swapper/010:23:210
35160,0ktimersoftd/30-21swapper/310:24:483
339960,0migration/37432-21sh12:26:563
339960,0migration/330958-21sh10:08:493
339960,0migration/326961-21sh11:58:003
339960,0migration/32422-21sh11:46:153
339960,0migration/315873-21sh11:17:393
339960,0migration/312757-21munin-node08:37:513
29805060,0irq/28-eth0-rx-29973-21perl12:02:503
29805060,0irq/28-eth0-rx-13594-21ssh09:58:353
29805060,0irq/28-eth0-rx-11288-21cat10:17:553
29805060,0irq/28-eth0-rx-0-21swapper/310:32:513
29805060,0irq/28-eth0-rx-0-21swapper/310:27:533
19160,0ktimersoftd/10-21swapper/111:01:411
179960,0migration/130203-21sh11:06:221
71099951,0cyclictest30235-21latency_hist09:52:342
71099950,0cyclictest7731-21munin-node08:57:442
71099950,0cyclictest7508-21latency_hist08:12:342
71099950,0cyclictest4283-21aten_r1power_fr09:17:462
71099950,0cyclictest3794-21latency_hist07:47:342
71099950,0cyclictest32732-21sort08:52:342
71099950,0cyclictest32638-21chrt08:07:382
71099950,0cyclictest29237-21sed09:12:332
71099950,0cyclictest29148-21grep12:02:352
71099950,0cyclictest28874-21wc07:42:342
71099950,0cyclictest25522-21basename08:02:462
71099950,0cyclictest25133-21cat12:37:352
71099950,0cyclictest21672-21cat07:37:342
71099950,0cyclictest18336-21sort08:42:342
71099950,0cyclictest18214-21sed07:57:342
71099950,0cyclictest18159-21grep11:37:342
71099950,0cyclictest17525-21latency_hist10:22:342
71099950,0cyclictest14956-21aten2.4-expect09:02:472
71099950,0cyclictest14703-21chrt08:17:422
71099950,0cyclictest1342-21date12:42:352
71089955,0cyclictest0-21swapper/111:40:521
71089955,0cyclictest0-21swapper/111:34:051
71089955,0cyclictest0-21swapper/109:57:081
71089955,0cyclictest0-21swapper/109:49:521
71089954,0cyclictest0-21swapper/107:47:511
71089950,0cyclictest0-21swapper/112:44:151
71089950,0cyclictest0-21swapper/112:23:071
71089950,0cyclictest0-21swapper/111:10:171
71089950,0cyclictest0-21swapper/109:30:381
71079955,0cyclictest0-21swapper/012:45:050
71079955,0cyclictest0-21swapper/011:08:350
71079955,0cyclictest0-21swapper/010:49:310
71079954,0cyclictest0-21swapper/011:00:140
4150,0ktimersoftd/00-21swapper/012:41:550
339950,0migration/38474-21kthreadcore10:52:513
339950,0migration/36927-21needreboot11:27:523
339950,0migration/36871-21kthreadcore07:47:523
339950,0migration/36026-21munin-node12:07:503
339950,0migration/34883-21kthreadcore08:52:523
339950,0migration/329648-21hddtemp_smartct10:47:483
339950,0migration/326835-21kthreadcore12:17:523
339950,0migration/325584-21aten_r1power_po08:02:463
339950,0migration/324374-21munin-node11:37:563
339950,0migration/324186-21needreboot07:57:533
339950,0migration/323831-21sh12:34:263
339950,0migration/321887-21latency_hist08:22:343
339950,0migration/321608-21taskset09:04:213
339950,0migration/320110-21munin-node10:42:473
339950,0migration/317669-21kthreadcore12:12:533
339950,0migration/317062-21kthreadcore10:02:513
339950,0migration/314654-21munin-node12:28:023
339950,0migration/312243-21sh09:42:133
329950,0watchdog/37923-21cpuspeed_turbos08:57:453
329950,0watchdog/36270-21ssh11:10:333
329950,0watchdog/332722-21kthreadcore09:12:533
329950,0watchdog/325616-21if_err_eth011:22:493
329950,0watchdog/322796-21if_err_eth107:37:493
329950,0watchdog/319351-21ssh09:43:013
329950,0watchdog/313191-21iostat_ios11:52:503
329950,0watchdog/30-21swapper/312:51:583
329950,0watchdog/30-21swapper/307:27:453
29815050,0irq/29-eth0-tx-21748-21munin-node07:37:490
29815050,0irq/29-eth0-tx-18418-21munin-node08:42:510
29815050,0irq/29-eth0-tx-0-21swapper/009:27:490
29815050,0irq/29-eth0-tx-0-21swapper/009:08:020
29805050,0irq/28-eth0-rx-6314-21runrttasks10:39:533
29805050,0irq/28-eth0-rx-5219-21kthreadcore11:47:533
29805050,0irq/28-eth0-rx-30986-21fschecks_time09:52:473
29805050,0irq/28-eth0-rx-25791-21kthreadcore09:47:523
29805050,0irq/28-eth0-rx-18383-21crond09:27:333
29805050,0irq/28-eth0-rx-1521-21ssh09:33:103
29805050,0irq/28-eth0-rx-0-21swapper/312:47:213
29805050,0irq/28-eth0-rx-0-21swapper/311:32:453
29805050,0irq/28-eth0-rx-0-21swapper/308:27:513
179950,0migration/16136-21kthreadcore10:32:551
179950,0migration/129984-21needreboot10:07:541
179950,0migration/129167-21aten_r1power_en08:27:441
179950,0migration/123514-21kthreadcore07:37:511
179950,0migration/117772-21if_eth112:32:521
179950,0migration/11626-21kthreadcore12:02:551
179950,0migration/112801-21kthreadcore12:27:541
179950,0migration/110489-21kthreadcore08:57:501
169950,0watchdog/18158-21kthreadcore11:47:541
169950,0watchdog/17533-21fschecks_time09:57:491
169950,0watchdog/115719-21perl09:02:491
169950,0watchdog/11018-21tune2fs10:12:491
149950,0migration/09479-21kthreadcore09:17:530
149950,0migration/06007-21kthreadcore09:37:520
149950,0migration/031403-21sh11:23:240
149950,0migration/028901-21latency_hist07:42:340
149950,0migration/027974-21idleruntime11:42:500
149950,0migration/027570-21kthreadcore12:17:520
149950,0migration/025403-21kthreadcore10:42:540
149950,0migration/013675-21kthreadcore11:32:530
149950,0migration/012820-21fschecks_time11:52:470
149950,0migration/010010-21kthreadcore12:27:530
71089943,0cyclictest3595-21sadc07:47:341
71089943,0cyclictest3571-21lldpd08:44:521
71089943,0cyclictest3524-21snmpd12:40:321
71089943,0cyclictest3524-21snmpd10:43:311
71089943,0cyclictest3524-21snmpd09:39:011
71089943,0cyclictest23953-21awk12:17:491
71089943,0cyclictest22994-21awk08:22:511
71089943,0cyclictest1504-21awk08:52:491
71079944,0cyclictest0-21swapper/012:52:580
71079943,0cyclictest6089-21awk10:52:490
71079943,0cyclictest5114-21awk08:32:520
71079943,0cyclictest3524-21snmpd11:03:010
71079943,0cyclictest3524-21snmpd08:00:000
71079943,0cyclictest3250-21irqbalance11:51:410
71079943,0cyclictest3250-21irqbalance09:42:400
71079943,0cyclictest3250-21irqbalance09:32:400
71079943,0cyclictest3250-21irqbalance09:27:300
71079943,0cyclictest3250-21irqbalance09:13:500
71079943,0cyclictest3250-21irqbalance08:52:400
71079943,0cyclictest3250-21irqbalance08:49:100
71079943,0cyclictest3250-21irqbalance08:38:100
71079943,0cyclictest15759-21awk08:17:500
71079943,0cyclictest1342-21awk10:12:510
71079943,0cyclictest1316-21awk08:07:510
71079943,0cyclictest11365-21awk12:47:530
71079943,0cyclictest10094-21awk10:17:510
339940,0migration/32377-21kthreadcore08:07:533
339940,0migration/318991-21kthreadcore07:32:543
339940,0migration/314466-21taskset08:17:333
329940,0watchdog/322377-21kthreadcore09:27:533
329940,0watchdog/317018-21kthreadcore08:17:533
329940,0watchdog/314264-21grep10:57:453
329940,0watchdog/30-21swapper/310:12:493
329940,0watchdog/30-21swapper/309:17:493
329940,0watchdog/30-21swapper/309:07:533
29815040,0irq/29-eth0-tx-7331-21munin-node07:27:590
29815040,0irq/29-eth0-tx-0-21swapper/007:52:450
29805040,0irq/28-eth0-rx-0-21swapper/311:12:373
29805040,0irq/28-eth0-rx-0-21swapper/311:03:203
29805040,0irq/28-eth0-rx-0-21swapper/307:42:543
179940,0migration/16756-21kthreadcore08:32:541
179940,0migration/16713-21munin-node12:07:521
179940,0migration/13315-21kthreadcore08:07:531
179940,0migration/131045-21kthreadcore09:32:541
179940,0migration/128621-21kthreadcore11:22:521
179940,0migration/121268-21kthreadcore12:52:531
179940,0migration/119852-21kthreadcore11:17:531
179940,0migration/118327-21kthreadcore07:32:541
179940,0migration/117443-21timerwakeupswit07:52:591
179940,0migration/116508-21kthreadcore08:37:531
179940,0migration/115927-21kthreadcore11:52:521
179940,0migration/114726-21kthreadcore09:42:521
179940,0migration/11041-21cpuspeed_turbos11:27:451
169940,0watchdog/17926-21kthreadcore09:17:531
169940,0watchdog/130760-21grep11:42:531
169940,0watchdog/130192-21perl09:12:491
169940,0watchdog/129642-21cut08:02:531
169940,0watchdog/127105-21cut09:07:531
169940,0watchdog/123978-21kthreadcore11:57:541
169940,0watchdog/121463-21ksmtuned08:20:011
169940,0watchdog/112938-21kthreadcore11:12:531
169940,0watchdog/112376-21ssh10:54:491
169940,0watchdog/10-21swapper/112:12:501
169940,0watchdog/10-21swapper/110:22:491
169940,0watchdog/10-21swapper/107:27:451
149940,0migration/05240-21kthreadcore11:27:500
149940,0migration/032247-21taskset08:05:460
149940,0migration/028949-21diskmemload10:27:520
149940,0migration/02050-21kthreadcore09:52:510
149940,0migration/017027-21kthreadcore07:32:540
149940,0migration/01619-21kthreadcore08:27:510
149940,0migration/015440-21aten_r1power_po10:02:460
149940,0migration/015363-21fschecks_count09:02:490
149940,0migration/014029-21kthreadcore10:37:520
149940,0migration/012820-21kthreadcore08:12:540
149940,0migration/01107-21kthreadcore12:22:570
149940,0migration/010447-21taskset07:48:200
8305030,0irq/26-0000:00:0-21swapper/307:52:343
71089933,0cyclictest16417-21awk10:02:491
71089933,0cyclictest0-21swapper/108:15:261
71089932,0cyclictest3571-21lldpd08:01:221
71089932,0cyclictest31474-21sort08:47:541
71089932,0cyclictest12510-21awk10:37:501
71089932,0cyclictest11414-21awk12:47:531
71079933,0cyclictest3571-21lldpd12:03:250
71079933,0cyclictest3571-21lldpd10:34:230
71079932,0cyclictest9924-21kthreadcore12:07:550
71079932,0cyclictest3524-21snmpd12:35:020
71079932,0cyclictest3524-21snmpd11:15:370
71079932,0cyclictest3250-21irqbalance08:57:400
71079932,0cyclictest24474-21cut10:07:470
71079932,0cyclictest21664-21grep11:17:530
71079932,0cyclictest20384-21ssh11:57:350
71079932,0cyclictest16234-21cut12:12:530
71079932,0cyclictest0-21swapper/008:25:100
71079930,0cyclictest0-21swapper/009:59:080
71079930,0cyclictest0-21swapper/009:47:340
329930,0watchdog/30-21swapper/308:32:493
29805030,0irq/28-eth0-rx-0-21swapper/308:47:463
29805030,0irq/28-eth0-rx-0-21swapper/308:42:463
179930,0migration/115952-21sh10:18:461
169930,0watchdog/10-21swapper/110:47:411
169930,0watchdog/10-21swapper/110:27:531
71089920,0cyclictest11424-21sed09:22:341
71079920,0cyclictest18196-21ssh11:37:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional