You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 01:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Mon May 04, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
71023726,0sleep10-21swapper/107:17:101
174723526,0sleep20-21swapper/207:19:272
182423127,0sleep00-21swapper/007:20:210
192323026,0sleep30-21swapper/307:21:333
2025991212,0cyclictest30890-21sensors11:57:131
20249977,0cyclictest3524-21snmpd07:59:260
339960,0migration/38249-21sh10:50:193
339960,0migration/37482-21sh09:36:083
339960,0migration/37482-21sh09:36:083
339960,0migration/34598-21sh12:40:153
339960,0migration/32845-21sh12:21:503
339960,0migration/32586-21sh11:06:593
339960,0migration/320334-21sh10:18:333
339960,0migration/317086-21sh10:55:543
339960,0migration/314491-21sh10:35:033
29805060,0irq/28-eth0-rx-32692-21python11:02:153
29805060,0irq/28-eth0-rx-30324-21sh09:29:453
29805060,0irq/28-eth0-rx-29497-21grep11:22:043
29805060,0irq/28-eth0-rx-2728-21cut10:27:093
29805060,0irq/28-eth0-rx-17638-21ssh12:11:113
20259965,0cyclictest14564-21fschecks_count12:47:041
149960,0migration/04113-21kthreadcore08:27:090
149960,0migration/0340-21taskset12:01:340
149960,0migration/028951-21kthreadcore11:02:080
149960,0migration/026405-21latency12:32:090
149960,0migration/019507-21munin-node11:52:090
4150,0ktimersoftd/00-21swapper/009:38:110
339950,0migration/39939-21kthreadcore10:12:103
339950,0migration/3957-21kthreadcore09:12:083
339950,0migration/38840-21munin-node08:07:133
339950,0migration/34213-21kthreadcore09:52:083
339950,0migration/33240-21kthreadcore08:27:083
339950,0migration/32955-21aten_r1power_vo08:52:033
339950,0migration/329540-21kthreadcore08:22:093
339950,0migration/329125-21irqrtprio08:02:073
339950,0migration/324285-21munin-node12:12:093
339950,0migration/322582-21kthreadcore12:32:083
339950,0migration/321703-21munin-node07:57:073
339950,0migration/320315-21taskset08:39:343
339950,0migration/320134-21fschecks_count10:02:053
339950,0migration/319195-21kthreadcore09:42:073
339950,0migration/315764-21munin-node08:12:103
339950,0migration/314194-21kthreadcore09:57:093
339950,0migration/312113-21kthreadcore07:27:083
339950,0migration/310772-21kthreadcore07:47:083
339950,0migration/310631-21taskset12:24:113
329950,0watchdog/3298050irq/28-eth0-rx-12:47:103
329950,0watchdog/328126-21ssh10:06:583
329950,0watchdog/326797-21kthreadcore10:22:103
329950,0watchdog/321750-21kthreadcore10:57:103
329950,0watchdog/312347-21kthreadcore08:57:093
329950,0watchdog/30-21swapper/311:47:063
329950,0watchdog/30-21swapper/311:32:023
29815050,0irq/29-eth0-tx-9827-21munin-node08:12:080
29815050,0irq/29-eth0-tx-6489-21cut10:47:102
29815050,0irq/29-eth0-tx-3810-21ssh11:24:182
29815050,0irq/29-eth0-tx-29197-21cut09:47:092
29815050,0irq/29-eth0-tx-26105-21cat10:42:072
29815050,0irq/29-eth0-tx-24452-21munin-node09:07:050
29815050,0irq/29-eth0-tx-22317-21munin-node11:37:052
29815050,0irq/29-eth0-tx-20632-21ssh09:22:452
29815050,0irq/29-eth0-tx-20336-21tr11:17:042
29815050,0irq/29-eth0-tx-19020-21ssh11:14:472
29815050,0irq/29-eth0-tx-18949-21taskset12:28:142
29815050,0irq/29-eth0-tx-14105-21munin-node12:47:042
29815050,0irq/29-eth0-tx-0-21swapper/210:16:252
29815050,0irq/29-eth0-tx-0-21swapper/210:10:542
29815050,0irq/29-eth0-tx-0-21swapper/209:45:012
29805050,0irq/28-eth0-rx-991-21ssh09:49:303
29805050,0irq/28-eth0-rx-30414-21munin-node09:07:093
29805050,0irq/28-eth0-rx-25716-21cut11:17:113
29805050,0irq/28-eth0-rx-25636-21irqrtprio10:42:073
29805050,0irq/28-eth0-rx-23790-40yum-updatesd-he08:19:193
29805050,0irq/28-eth0-rx-23165-21sh11:53:423
29805050,0irq/28-eth0-rx-16730-21cut10:37:083
29805050,0irq/28-eth0-rx-13062-21latency_hist07:51:503
29805050,0irq/28-eth0-rx-12179-21vmstat12:42:193
29805050,0irq/28-eth0-rx-0-21swapper/311:42:183
29805050,0irq/28-eth0-rx-0-21swapper/311:27:033
29805050,0irq/28-eth0-rx-0-21swapper/309:37:043
259950,0migration/26782-21taskset09:34:222
259950,0migration/26782-21taskset09:34:222
259950,0migration/25319-21kthreadcore09:52:082
259950,0migration/225314-21sh12:13:202
259950,0migration/219905-21proc_pri11:32:122
259950,0migration/219305-21latency_hist10:01:512
259950,0migration/213209-21latency_hist07:51:502
249950,0watchdog/210833-21kthreadcore10:32:102
249950,0watchdog/210620-21cut08:32:092
20259955,0cyclictest0-21swapper/111:22:061
20259954,0cyclictest17980-21ps07:32:071
20259950,0cyclictest13574-21diskmemload10:54:301
20249955,0cyclictest0-21swapper/012:25:560
20249955,0cyclictest0-21swapper/012:08:070
20249955,0cyclictest0-21swapper/007:51:560
20249954,0cyclictest17857-21awk07:32:060
20249953,0cyclictest13145-21kworker/0:011:10:220
20249950,0cyclictest0-21swapper/012:44:510
20249950,0cyclictest0-21swapper/012:04:110
20249950,0cyclictest0-21swapper/009:51:350
19150,0ktimersoftd/124469-21ssh09:44:211
179950,0migration/17749-21runrttasks12:02:401
179950,0migration/16649-21kthreadcore12:22:091
179950,0migration/129318-21kthreadcore11:02:081
179950,0migration/12817-21sh10:08:151
179950,0migration/12078-21kthreadcore08:27:081
179950,0migration/116814-21turbostat08:16:501
179950,0migration/116755-21fschecks_time11:52:041
179950,0migration/116700-21latency_hist09:41:511
179950,0migration/111341-21kthreadcore07:47:081
179950,0migration/110226-21taskset11:09:241
149950,0migration/07381-21sh09:35:550
149950,0migration/07381-21sh09:35:550
149950,0migration/06810-21fschecks_time07:47:040
149950,0migration/04297-21kthreadcore09:52:080
149950,0migration/04295-21sh12:39:250
149950,0migration/030796-21kthreadcore08:47:080
149950,0migration/028895-21kthreadcore12:17:070
149950,0migration/027051-21kthreadcore11:37:080
149950,0migration/026736-21kthreadcore08:22:080
149950,0migration/026506-21kthreadcore07:37:070
149950,0migration/022633-21kthreadcore12:12:070
149950,0migration/020751-21kthreadcore10:57:090
149950,0migration/020043-21sh11:17:030
149950,0migration/019729-21kthreadcore09:42:070
149950,0migration/018572-21kthreadcore12:47:090
149950,0migration/015499-21aten2.4-expect10:37:020
149950,0migration/015491-21kthreadcore11:12:090
149950,0migration/015357-21kthreadcore09:57:090
149950,0migration/015351-21kthreadcore12:27:100
149950,0migration/014838-21munin-node11:32:070
149950,0migration/013744-21latency_hist09:21:510
149950,0migration/01369-21kthreadcore11:22:090
149950,0migration/012492-21taskset11:29:180
149950,0migration/011939-21kthreadcore09:17:090
149950,0migration/010912-21kthreadcore11:47:100
339940,0migration/37296-21kthreadcore07:22:083
339940,0migration/36851-21cpuspeed_turbos09:17:043
339940,0migration/326026-21kthreadcore08:42:083
339940,0migration/314262-21kthreadcore11:12:093
329940,0watchdog/34713-21mdstat07:42:093
329940,0watchdog/329869-21missed_timers07:37:093
329940,0watchdog/316805-21aten_r1power_en07:32:013
329940,0watchdog/30-21swapper/312:02:103
329940,0watchdog/30-21swapper/311:37:063
329940,0watchdog/30-21swapper/309:22:093
329940,0watchdog/30-21swapper/309:02:053
329940,0watchdog/30-21swapper/308:32:093
29815040,0irq/29-eth0-tx-3524-21snmpd07:24:190
29815040,0irq/29-eth0-tx-15438-21munin-node10:37:072
29815040,0irq/29-eth0-tx-0-21swapper/211:57:132
29815040,0irq/29-eth0-tx-0-21swapper/211:51:592
29815040,0irq/29-eth0-tx-0-21swapper/211:02:292
29815040,0irq/29-eth0-tx-0-21swapper/210:57:002
29815040,0irq/29-eth0-tx-0-21swapper/210:51:562
29815040,0irq/29-eth0-tx-0-21swapper/210:01:572
29815040,0irq/29-eth0-tx-0-21swapper/009:02:090
29815040,0irq/29-eth0-tx-0-21swapper/007:42:020
29805040,0irq/28-eth0-rx-0-21swapper/312:29:193
29805040,0irq/28-eth0-rx-0-21swapper/311:58:053
259940,0migration/2950-21kthreadcore08:02:092
259940,0migration/2695-21runrttasks12:01:562
259940,0migration/25942-21runrttasks09:12:212
259940,0migration/23929-21kthreadcore08:27:092
259940,0migration/232088-21kthreadcore10:27:082
259940,0migration/222733-21gltestperf10:22:052
259940,0migration/219892-21kthreadcore07:32:082
259940,0migration/217744-21fschecks_time08:17:042
259940,0migration/210689-21kthreadcore09:37:082
249940,0watchdog/232223-21if_err_eth007:42:052
249940,0watchdog/220597-21aten_r1power_fr12:32:022
249940,0watchdog/219487-21netstat08:37:092
249940,0watchdog/210442-21cut11:47:102
249940,0watchdog/20-21swapper/212:37:142
249940,0watchdog/20-21swapper/210:17:062
249940,0watchdog/20-21swapper/209:02:052
20319943,0cyclictest6613-21awk12:42:082
20319943,0cyclictest3571-21lldpd12:21:522
20319943,0cyclictest3571-21lldpd11:42:212
20319943,0cyclictest3571-21lldpd11:26:512
20319943,0cyclictest3571-21lldpd11:06:512
20319943,0cyclictest3571-21lldpd08:57:192
20319943,0cyclictest3571-21lldpd08:12:192
20319943,0cyclictest3571-21lldpd07:22:182
20319943,0cyclictest3250-21irqbalance09:27:272
20319943,0cyclictest3250-21irqbalance09:17:172
20319943,0cyclictest3250-21irqbalance08:51:572
20319943,0cyclictest3250-21irqbalance08:48:472
20319943,0cyclictest3250-21irqbalance08:42:272
20319943,0cyclictest3250-21irqbalance08:22:572
20319943,0cyclictest3250-21irqbalance08:07:372
20319943,0cyclictest3250-21irqbalance07:57:272
20319943,0cyclictest3250-21irqbalance07:48:272
20319943,0cyclictest3250-21irqbalance07:36:562
20319943,0cyclictest3250-21irqbalance07:27:062
20319943,0cyclictest28010-21awk12:17:062
20319943,0cyclictest25526-21awk09:07:052
20319943,0cyclictest10628-21awk12:07:062
20259943,0cyclictest9593-21sadc08:11:501
20259943,0cyclictest7926-21awk10:32:071
20259943,0cyclictest6098-21awk11:27:071
20259943,0cyclictest3571-21lldpd11:15:501
20259943,0cyclictest3524-21snmpd10:43:431
20259943,0cyclictest3524-21snmpd07:40:111
20259943,0cyclictest32630-21awk09:32:061
20259943,0cyclictest32630-21awk09:32:061
20259943,0cyclictest30324-21awk12:37:081
20259943,0cyclictest29043-21awk08:47:051
20259943,0cyclictest19286-21awk12:12:051
20259943,0cyclictest14625-21awk08:37:051
20259943,0cyclictest11134-21awk08:57:071
20249944,0cyclictest0-21swapper/010:30:130
20249944,0cyclictest0-21swapper/010:03:060
20249943,0cyclictest7887-21awk10:32:070
20249943,0cyclictest5615-21awk10:12:070
20249943,0cyclictest4036-21awk08:52:070
20249943,0cyclictest3524-21snmpd10:21:570
20249943,0cyclictest28856-21awk08:02:060
179940,0migration/19542-21kthreadcore09:17:091
179940,0migration/15229-21kthreadcore08:52:091
179940,0migration/14581-21kthreadcore07:22:071
179940,0migration/129601-21kthreadcore12:17:081
179940,0migration/129419-21kthreadcore08:02:071
179940,0migration/127564-21kthreadcore09:47:081
179940,0migration/125248-21kthreadcore08:42:081
179940,0migration/124488-21cpuspeed_turbos08:22:031
179940,0migration/122935-21missed_timers08:17:101
179940,0migration/122886-21kthreadcore09:02:061
179940,0migration/122073-21kernelversion07:57:081
179940,0migration/121268-21sh11:17:081
179940,0migration/112909-21latency_hist10:16:501
179940,0migration/112895-21kthreadcore09:57:081
179940,0migration/111956-21aten_r1power_fr12:27:031
169940,0watchdog/16455-21cat10:47:101
169940,0watchdog/13854-21kthreadcore10:27:101
169940,0watchdog/13524-21snmpd09:09:411
169940,0watchdog/13256-21rm09:52:061
169940,0watchdog/130516-21ssh11:41:341
169940,0watchdog/126796-21kthreadcore10:22:101
169940,0watchdog/123205-21kthreadcore10:02:101
169940,0watchdog/122576-21ssh09:26:571
169940,0watchdog/117298-21ssh12:10:141
169940,0watchdog/114155-21hwlatdetect10:17:061
169940,0watchdog/113734-21aten2.4-expect11:32:021
169940,0watchdog/113351-21aten_r1power_en07:52:011
169940,0watchdog/10-21swapper/112:32:021
169940,0watchdog/10-21swapper/111:47:101
169940,0watchdog/10-21swapper/109:22:091
149940,0migration/024293-21kthreadcore08:42:080
149940,0migration/020531-21sh10:19:060
149940,0migration/011266-21kthreadcore10:52:090
329930,0watchdog/30-21swapper/308:47:013
20259932,0cyclictest10487-21head07:27:041
20259930,0cyclictest5584-21smart_sda09:12:131
20249933,0cyclictest3571-21lldpd09:27:190
20249933,0cyclictest0-21swapper/010:49:170
20249932,0cyclictest3776-21awk08:07:050
20249932,0cyclictest3571-21lldpd08:33:490
20249932,0cyclictest32718-21awk09:12:050
20249932,0cyclictest17211-21wc08:17:030
20249932,0cyclictest1580-21kthreadcore11:42:090
20249932,0cyclictest14528-21kthreadcore07:27:080
20249932,0cyclictest11119-21awk08:57:070
20249930,0cyclictest14274-21perl08:37:030
169930,0watchdog/10-21swapper/112:42:101
169930,0watchdog/10-21swapper/111:44:181
169930,0watchdog/10-21swapper/110:57:101
169930,0watchdog/10-21swapper/110:37:061
169930,0watchdog/10-21swapper/108:32:051
169930,0watchdog/10-21swapper/107:42:051
149930,0migration/03778-21runrttasks10:10:460
149930,0migration/031097-21sh10:43:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional