You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-28 - 03:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Thu May 28, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1275124031,0sleep10-21swapper/119:23:131
1253824035,0sleep00-21swapper/019:20:440
1273023627,0sleep30-21swapper/319:22:593
1279623228,0sleep20-21swapper/219:23:422
339960,0migration/35443-21taskset23:21:093
339960,0migration/331856-21sh00:52:363
339960,0migration/331656-21irqcore00:34:043
339960,0migration/32972-21sh21:47:003
339960,0migration/328728-21sh22:01:073
339960,0migration/31894-21sh22:43:413
339960,0migration/313331-21kthreadcore19:44:043
339960,0migration/311580-21sh00:19:543
29805060,0irq/28-eth0-rx-7512-21fschecks_time00:39:003
27160,0ktimersoftd/20-21swapper/222:49:062
128759966,0cyclictest83050irq/26-0000:00:21:49:022
8305050,0irq/26-0000:00:28004-21sa100:13:472
339950,0migration/38751-21taskset21:31:503
339950,0migration/37383-21idleruntime22:09:013
339950,0migration/36988-21cpuspeed_turbos23:23:583
339950,0migration/3655-21fschecks_count23:38:593
339950,0migration/331902-21taskset22:23:233
339950,0migration/331806-21fschecks_time19:58:593
339950,0migration/331429-21kthreadcore00:14:053
339950,0migration/329973-21kthreadcore21:24:043
339950,0migration/329525-21kthreadcore19:34:023
339950,0migration/328361-21aten_r1power_vo22:58:583
339950,0migration/326127-21aten_r1power_cu23:53:583
339950,0migration/323264-21taskset00:47:483
339950,0migration/322757-21kthreadcore22:34:053
339950,0migration/322639-21fschecks_time00:29:013
339950,0migration/321522-21fschecks_time20:58:593
339950,0migration/321475-21idleruntime20:14:013
339950,0migration/320683-21sh21:57:403
339950,0migration/319374-21munin-node00:24:083
339950,0migration/319235-21runrttasks20:09:043
339950,0migration/318360-21fschecks_time23:49:013
339950,0migration/317417-21df_abs20:33:583
339950,0migration/317204-21fschecks_count19:49:003
339950,0migration/314518-21munin-node20:54:013
339950,0migration/313110-21kthreadcore22:49:043
339950,0migration/310722-21fschecks_time21:33:593
339950,0migration/310187-21aten_r1power_vo21:13:593
329950,0watchdog/324344-21diskstats23:33:583
329950,0watchdog/322424-21ssh22:16:103
329950,0watchdog/312557-21python20:49:093
329950,0watchdog/30-21swapper/322:46:103
329950,0watchdog/30-21swapper/322:23:583
29815050,0irq/29-eth0-tx-8848-21munin-node23:44:012
29815050,0irq/29-eth0-tx-31439-21munin-node20:44:050
29815050,0irq/29-eth0-tx-31268-21ssh21:24:272
29815050,0irq/29-eth0-tx-30511-21ssh22:19:332
29815050,0irq/29-eth0-tx-30382-21munin-node23:19:002
29815050,0irq/29-eth0-tx-20861-21iostat_ios22:54:032
29815050,0irq/29-eth0-tx-17522-21munin-node23:49:032
29815050,0irq/29-eth0-tx-15317-21munin-node23:29:122
29815050,0irq/29-eth0-tx-0-21swapper/223:09:092
29815050,0irq/29-eth0-tx-0-21swapper/222:44:002
29815050,0irq/29-eth0-tx-0-21swapper/221:39:382
29815050,0irq/29-eth0-tx-0-21swapper/221:36:492
29815050,0irq/29-eth0-tx-0-21swapper/200:30:152
29815050,0irq/29-eth0-tx-0-21swapper/200:14:092
29815050,0irq/29-eth0-tx-0-21swapper/021:14:070
29815050,0irq/29-eth0-tx-0-21swapper/020:04:050
29815050,0irq/29-eth0-tx-0-21swapper/020:04:050
29805050,0irq/28-eth0-rx-8791-21kthreadcore23:04:043
29805050,0irq/28-eth0-rx-8558-21pmu-power23:59:083
29805050,0irq/28-eth0-rx-21965-21cut22:54:043
29805050,0irq/28-eth0-rx-15203-21sendmail_mailst23:44:083
29805050,0irq/28-eth0-rx-13480-21grep23:08:593
29805050,0irq/28-eth0-rx-0-21swapper/323:29:083
29805050,0irq/28-eth0-rx-0-21swapper/323:14:043
29805050,0irq/28-eth0-rx-0-21swapper/322:30:213
29805050,0irq/28-eth0-rx-0-21swapper/322:08:463
29805050,0irq/28-eth0-rx-0-21swapper/321:49:033
29805050,0irq/28-eth0-rx-0-21swapper/321:39:023
29805050,0irq/28-eth0-rx-0-21swapper/320:19:043
259950,0migration/2873-21missed_timers19:34:042
259950,0migration/2409-21sh22:39:432
259950,0migration/23879-21kthreadcore23:39:042
259950,0migration/23645-21fschecks_time21:08:592
259950,0migration/23162-21fschecks_time23:59:012
259950,0migration/23160-21kthreadcore19:59:032
259950,0migration/230457-21munin-node23:34:102
259950,0migration/230162-21kthreadcore22:59:042
259950,0migration/227143-21kthreadcore19:54:032
259950,0migration/225842-21kthreadcore00:49:052
259950,0migration/216987-21missed_timers00:04:052
259950,0migration/213936-21irqcore21:54:022
259950,0migration/212791-21kthreadcore22:29:052
179950,0migration/19972-21latency21:49:061
179950,0migration/15698-21kthreadcore19:39:031
179950,0migration/128954-21kthreadcore00:49:061
179950,0migration/126933-21smart_sdb20:59:081
179950,0migration/121387-21kthreadcore21:39:021
179950,0migration/116690-21kthreadcore20:09:021
179950,0migration/116333-21irqcore22:14:021
179950,0migration/115642-21kthreadcore21:34:031
179950,0migration/114066-21fschecks_time23:09:011
179950,0migration/113830-21fschecks_time19:23:591
179950,0migration/113412-21latency_hist20:53:461
179950,0migration/112267-21irqcore00:04:021
179950,0migration/111520-21kthreadcore22:09:041
169950,0watchdog/126179-21kthreadcore20:39:011
149950,0migration/09506-21latency_hist19:43:460
149950,0migration/09118-21fschecks_count22:29:000
149950,0migration/09091-21kthreadcore00:19:060
149950,0migration/07076-21sh22:25:120
149950,0migration/0531-21kthreadcore22:04:030
149950,0migration/05068-21idleruntime21:49:020
149950,0migration/04230-21taskset00:18:380
149950,0migration/032370-21switchtime22:39:110
149950,0migration/031203-21fschecks_time23:18:590
149950,0migration/029069-21kthreadcore00:49:060
149950,0migration/028399-21fschecks_count21:04:000
149950,0migration/027392-21kthreadcore21:24:040
149950,0migration/025499-21kthreadcore22:19:040
149950,0migration/023755-21switchtime22:34:120
149950,0migration/023238-21kthreadcore20:59:020
149950,0migration/023136-21kthreadcore20:14:030
149950,0migration/021716-21sh23:13:510
149950,0migration/020806-21kthreadcore23:49:050
149950,0migration/019310-21taskset22:53:390
149950,0migration/01865-21hwlatdetect21:29:010
149950,0migration/015287-21kthreadcore00:04:040
149950,0migration/014654-21kthreadcore19:24:030
149950,0migration/014125-21taskset23:26:120
149950,0migration/011245-21kthreadcore22:09:040
128729955,0cyclictest4834-21kworker/0:221:44:320
128729955,0cyclictest4834-21kworker/0:221:19:200
128729955,0cyclictest4834-21kworker/0:221:09:040
128729955,0cyclictest4834-21kworker/0:220:54:490
128729955,0cyclictest4834-21kworker/0:220:50:010
128729955,0cyclictest4834-21kworker/0:220:39:250
128729955,0cyclictest4834-21kworker/0:220:33:590
128729955,0cyclictest4834-21kworker/0:220:29:090
128729955,0cyclictest4834-21kworker/0:220:24:230
128729955,0cyclictest4834-21kworker/0:220:19:350
128729955,0cyclictest4834-21kworker/0:220:10:050
128729955,0cyclictest4834-21kworker/0:219:58:530
128729955,0cyclictest4834-21kworker/0:219:55:290
128729955,0cyclictest4834-21kworker/0:219:48:490
128729955,0cyclictest4834-21kworker/0:219:38:510
128729955,0cyclictest4834-21kworker/0:219:28:550
128729955,0cyclictest0-21swapper/019:33:540
128729955,0cyclictest0-21swapper/000:24:000
128729950,0cyclictest0-21swapper/023:58:180
128729950,0cyclictest0-21swapper/000:11:230
339940,0migration/35408-21kthreadcore21:09:033
339940,0migration/328392-21fschecks_count21:04:003
339940,0migration/323527-21kthreadcore19:29:053
339940,0migration/322304-21kthreadcore00:09:043
339940,0migration/312064-21kthreadcore20:29:033
329940,0watchdog/3128492sleep320:06:453
329940,0watchdog/3128492sleep320:06:453
329940,0watchdog/30-21swapper/320:39:013
329940,0watchdog/30-21swapper/320:24:013
29815040,0irq/29-eth0-tx-24266-21diskmemload00:34:432
29815040,0irq/29-eth0-tx-0-21swapper/223:53:572
29815040,0irq/29-eth0-tx-0-21swapper/222:08:532
29815040,0irq/29-eth0-tx-0-21swapper/222:05:012
29815040,0irq/29-eth0-tx-0-21swapper/222:00:062
29815040,0irq/29-eth0-tx-0-21swapper/221:44:052
29815040,0irq/29-eth0-tx-0-21swapper/221:28:572
29805040,0irq/28-eth0-rx-24110-40yum-updatesd-he21:22:143
29805040,0irq/28-eth0-rx-0-21swapper/320:44:003
29805040,0irq/28-eth0-rx-0-21swapper/300:04:293
259940,0migration/27583-21kthreadcore23:04:032
259940,0migration/23060-21fschecks_time19:38:592
259940,0migration/228633-21munin-node20:19:012
259940,0migration/227536-21kthreadcore20:39:022
259940,0migration/227211-21runrttasks20:16:242
259940,0migration/220764-21kthreadcore22:34:052
259940,0migration/216822-21kthreadcore22:14:022
259940,0migration/210427-21fschecks_time19:44:002
249940,0watchdog/232553-21cpuspeed_turbos22:23:582
249940,0watchdog/218397-21if_eth1.221:19:012
249940,0watchdog/215299-21ssh00:43:542
249940,0watchdog/210229-21kthreadcore00:19:062
249940,0watchdog/20-21swapper/220:24:012
179940,0migration/19267-21runrttasks20:25:151
179940,0migration/19194-21fschecks_count22:29:001
179940,0migration/129717-21kthreadcore19:34:021
179940,0migration/129137-21runrttasks23:16:051
179940,0migration/127524-21kthreadcore22:19:051
179940,0migration/123555-21kthreadcore00:09:051
179940,0migration/120857-21munin-node22:54:031
179940,0migration/120014-21kthreadcore19:49:041
179940,0migration/11626-21fschecks_time21:29:001
179940,0migration/115200-21latency_hist23:28:471
179940,0migration/111470-21kthreadcore23:44:041
179940,0migration/110454-21kthreadcore00:39:041
169940,0watchdog/16314-21runrttasks23:51:421
169940,0watchdog/13443-21ssh22:44:021
169940,0watchdog/131135-21munin-node19:58:571
169940,0watchdog/129962-21ssh22:03:531
169940,0watchdog/128737-21ssh00:29:461
169940,0watchdog/124622-21ssh22:35:461
169940,0watchdog/122765-21ssh00:46:221
169940,0watchdog/120166-21ssh00:24:541
169940,0watchdog/110227-21kthreadcore00:19:061
169940,0watchdog/10-21swapper/121:04:011
149940,0migration/02221-21latency_hist23:58:470
149940,0migration/017744-21kthreadcore22:14:030
149940,0migration/010169-21kthreadcore23:04:040
128759943,0cyclictest7259-21grep20:04:012
128759943,0cyclictest7259-21grep20:04:012
128759943,0cyclictest3571-21lldpd23:24:142
128759943,0cyclictest3571-21lldpd20:55:432
128759943,0cyclictest21799-21awk20:59:002
128759943,0cyclictest18066-21awk20:34:012
128759943,0cyclictest16784-21sadc20:33:472
128759943,0cyclictest14330-21awk20:09:002
128759943,0cyclictest11129-21awk21:14:022
128759940,0cyclictest6693-21munin-node00:39:052
128759940,0cyclictest21753-21munin-node23:14:052
128759940,0cyclictest13240-21munin-node00:24:052
128739944,0cyclictest0-21swapper/121:23:581
128739943,0cyclictest8569-21sadc23:43:471
128739943,0cyclictest7062-21awk20:04:001
128739943,0cyclictest7062-21awk20:04:001
128739943,0cyclictest3571-21lldpd23:19:451
128739943,0cyclictest3571-21lldpd23:07:151
128739943,0cyclictest3571-21lldpd22:49:151
128739943,0cyclictest3571-21lldpd21:19:131
128739943,0cyclictest3571-21lldpd21:11:431
128739943,0cyclictest3571-21lldpd20:48:131
128739943,0cyclictest3571-21lldpd20:29:131
128739943,0cyclictest3571-21lldpd20:20:131
128739943,0cyclictest3571-21lldpd20:14:431
128739943,0cyclictest3524-21snmpd23:36:531
128739943,0cyclictest3524-21snmpd23:27:531
128739943,0cyclictest3524-21snmpd22:27:071
128739943,0cyclictest3524-21snmpd21:58:521
128739943,0cyclictest28732-21awk21:44:021
128739943,0cyclictest24987-21awk19:54:011
128739943,0cyclictest21437-21awk19:29:031
128739943,0cyclictest18676-21wc21:54:041
128739943,0cyclictest14624-21awk20:54:011
128739943,0cyclictest11177-21awk21:14:031
128739940,0cyclictest0-21swapper/123:54:031
128729944,0cyclictest0-21swapper/022:01:190
128729944,0cyclictest0-21swapper/021:41:180
128729944,0cyclictest0-21swapper/000:46:420
128729944,0cyclictest0-21swapper/000:29:030
128729943,0cyclictest9974-21awk23:44:020
128729943,0cyclictest3571-21lldpd21:34:130
128729943,0cyclictest3524-21snmpd22:54:370
128729943,0cyclictest3442-21awk22:44:010
128729943,0cyclictest3250-21irqbalance23:39:130
128729943,0cyclictest3250-21irqbalance23:34:030
128729943,0cyclictest3250-21irqbalance23:33:230
128729943,0cyclictest3250-21irqbalance23:09:230
128729943,0cyclictest3250-21irqbalance21:54:030
128729943,0cyclictest3250-21irqbalance00:39:430
128729943,0cyclictest29401-21awk22:59:020
128729943,0cyclictest0-21swapper/000:34:050
8305030,0irq/26-0000:00:0-21swapper/319:23:463
8305030,0irq/26-0000:00:0-21swapper/220:49:222
329930,0watchdog/30-21swapper/319:54:093
329930,0watchdog/30-21swapper/319:38:573
259930,0migration/25078-21runrttasks20:44:062
259930,0migration/228373-21fschecks_count21:04:002
259930,0migration/216803-21sh19:48:582
249930,0watchdog/20-21swapper/219:29:052
179930,0migration/19484-21latency_hist19:43:461
169930,0watchdog/10-21swapper/122:39:581
169930,0watchdog/10-21swapper/120:34:011
169930,0watchdog/10-21swapper/100:34:181
169930,0watchdog/10-21swapper/100:15:181
128739932,0cyclictest3521-21awk23:59:031
128739932,0cyclictest24266-21diskmemload22:59:041
249920,0watchdog/20-21swapper/219:23:492
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional