You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-21 - 13:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Sun Jun 21, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1479424940,0sleep20-21swapper/219:25:002
1455123727,0sleep30-21swapper/319:22:043
1460023622,0sleep00-21swapper/019:22:410
792523424,0sleep10-21swapper/119:20:541
339960,0migration/33784-21munin-node21:31:003
339960,0migration/325115-21sh00:48:143
339960,0migration/317379-21sh22:32:323
339960,0migration/315974-21sh23:28:363
339960,0migration/315137-21sh23:10:593
339960,0migration/310377-21kthreadcore22:11:023
329960,0watchdog/39108-21sh22:28:353
329960,0watchdog/3337-21python21:26:073
29815060,0irq/29-eth0-tx-22540-21munin-node20:15:550
29805060,0irq/28-eth0-rx-6763-21sh23:22:083
29805060,0irq/28-eth0-rx-3246-21memory23:01:033
29805060,0irq/28-eth0-rx-30583-21cut23:36:023
29805060,0irq/28-eth0-rx-22208-21cat21:41:033
29805060,0irq/28-eth0-rx-0-21swapper/322:42:003
149349960,0cyclictest0-21swapper/023:26:000
149960,0migration/08591-21kthreadcore00:01:020
149960,0migration/05382-21pmu-power22:06:070
149960,0migration/02212-21taskset22:42:270
8305050,0irq/26-0000:00:0-21swapper/220:30:442
339950,0migration/39462-21kthreadcore23:06:033
339950,0migration/328176-21kthreadcore20:41:023
339950,0migration/323845-21latency_hist00:30:453
339950,0migration/323534-21munin-node20:15:583
339950,0migration/322686-21latency_hist22:00:453
339950,0migration/320980-21kthreadcore22:36:033
339950,0migration/319110-21aten_r1power_fr20:35:553
339950,0migration/317100-21kthreadcore21:16:013
339950,0migration/314559-21timerwakeupswit20:06:093
339950,0migration/313958-21gltestperf00:06:003
339950,0migration/310749-21kthreadcore20:51:013
329950,0watchdog/39475-21sh00:41:003
329950,0watchdog/3908-40yum-updatesd-he22:25:073
329950,0watchdog/321071-21kthreadcore20:11:033
329950,0watchdog/30-21swapper/323:31:043
329950,0watchdog/30-21swapper/319:55:593
29815050,0irq/29-eth0-tx-29052-21ssh00:13:082
29815050,0irq/29-eth0-tx-28971-21munin-node21:01:070
29815050,0irq/29-eth0-tx-15564-21munin-node20:56:060
29815050,0irq/29-eth0-tx-15367-21munin-node20:11:030
29815050,0irq/29-eth0-tx-12368-21sensors_temp23:06:082
29815050,0irq/29-eth0-tx-0-21swapper/222:46:022
29815050,0irq/29-eth0-tx-0-21swapper/222:01:372
29815050,0irq/29-eth0-tx-0-21swapper/200:39:392
29815050,0irq/29-eth0-tx-0-21swapper/200:31:362
29815050,0irq/29-eth0-tx-0-21swapper/021:26:050
29815050,0irq/29-eth0-tx-0-21swapper/020:50:390
29815050,0irq/29-eth0-tx-0-21swapper/020:26:090
29815050,0irq/29-eth0-tx-0-21swapper/019:47:350
29805050,0irq/28-eth0-rx-7740-21kthreadcore21:51:013
29805050,0irq/28-eth0-rx-7331-21fschecks_time00:20:583
29805050,0irq/28-eth0-rx-4879-21cut21:10:553
29805050,0irq/28-eth0-rx-20379-21port_sshpriv21:56:063
29805050,0irq/28-eth0-rx-17810-21ssh23:47:153
29805050,0irq/28-eth0-rx-0-21swapper/323:40:583
29805050,0irq/28-eth0-rx-0-21swapper/323:18:503
29805050,0irq/28-eth0-rx-0-21swapper/322:56:573
29805050,0irq/28-eth0-rx-0-21swapper/322:50:583
29805050,0irq/28-eth0-rx-0-21swapper/322:46:043
29805050,0irq/28-eth0-rx-0-21swapper/322:17:193
29805050,0irq/28-eth0-rx-0-21swapper/322:09:363
29805050,0irq/28-eth0-rx-0-21swapper/321:39:583
29805050,0irq/28-eth0-rx-0-21swapper/300:50:583
29805050,0irq/28-eth0-rx-0-21swapper/300:31:333
29805050,0irq/28-eth0-rx-0-21swapper/300:14:513
29805050,0irq/28-eth0-rx-0-21swapper/300:03:263
259950,0migration/25360-21kthreadcore20:01:012
259950,0migration/24276-21kthreadcore23:21:022
259950,0migration/229846-21fschecks_time21:45:582
259950,0migration/228575-21kthreadcore21:26:022
259950,0migration/224902-21netstat22:36:052
259950,0migration/223379-21sendmail_mailst23:31:082
259950,0migration/216880-21kthreadcore00:06:042
259950,0migration/21070-21kthreadcore19:36:012
249950,0watchdog/21215-21ssh00:52:522
179950,0migration/12725-21fschecks_time23:40:581
149509955,0cyclictest11272-21dump-pmu-power21:35:442
149509955,0cyclictest0-21swapper/223:50:482
149509955,0cyclictest0-21swapper/223:48:072
149509955,0cyclictest0-21swapper/222:12:162
149509955,0cyclictest0-21swapper/200:19:202
149509954,0cyclictest3524-21snmpd20:58:002
149509950,0cyclictest26277-21diskmemload23:15:292
149509950,0cyclictest0-21swapper/221:42:092
149449955,0cyclictest26277-21diskmemload23:14:021
149449954,0cyclictest3571-21lldpd23:01:361
149449954,0cyclictest3524-21snmpd21:52:161
149349955,0cyclictest0-21swapper/023:13:320
149349953,0cyclictest18291-21kworker/0:123:45:460
149349953,0cyclictest18291-21kworker/0:123:31:020
149349953,0cyclictest18291-21kworker/0:123:05:460
149349953,0cyclictest18291-21kworker/0:122:55:460
149349953,0cyclictest18291-21kworker/0:122:16:020
149349953,0cyclictest18291-21kworker/0:121:55:460
149349953,0cyclictest18291-21kworker/0:121:46:000
149349953,0cyclictest18291-21kworker/0:100:15:460
149349950,0cyclictest0-21swapper/023:17:290
149349950,0cyclictest0-21swapper/022:24:210
149950,0migration/08396-21smart_nvme0n123:41:070
149950,0migration/06705-21aten_r1power_fr00:20:560
149950,0migration/06172-21kthreadcore22:46:030
149950,0migration/03811-21timerandwakeup23:01:090
149950,0migration/032019-21aten_r1power_cu23:20:550
149950,0migration/030615-21kthreadcore20:41:030
149950,0migration/030596-21munin-node19:35:580
149950,0migration/029605-21sh22:01:160
149950,0migration/028829-21kthreadcore00:31:030
149950,0migration/028074-21sh23:55:560
149950,0migration/027392-21kthreadcore23:36:010
149950,0migration/02470-21kthreadcore20:01:000
149950,0migration/023887-21kthreadcore21:21:010
149950,0migration/023396-21sh00:29:560
149950,0migration/022082-21kthreadcore23:51:010
149950,0migration/021635-21aten_r1power_cu00:10:550
149950,0migration/016649-21sh00:43:430
149950,0migration/013217-21kthreadcore22:11:030
149950,0migration/011993-21kthreadcore20:51:010
149950,0migration/010699-21kthreadcore20:06:020
149950,0migration/010633-21taskset21:34:040
8305040,0irq/26-0000:00:0-21swapper/222:40:442
339940,0migration/330586-21kthreadcore23:56:023
339940,0migration/320735-21irqrtprio21:21:003
339940,0migration/311326-21taskset20:27:173
329940,0watchdog/330714-21if_eth1.319:35:593
329940,0watchdog/330232-21taskset00:15:483
329940,0watchdog/327923-21kthreadcore21:01:033
329940,0watchdog/323128-21cut19:51:033
329940,0watchdog/30-21swapper/320:00:553
329940,0watchdog/30-21swapper/319:42:593
29815040,0irq/29-eth0-tx-4295-21ssh00:00:482
29815040,0irq/29-eth0-tx-25617-21latency_hist23:35:442
29815040,0irq/29-eth0-tx-25127-21ssh22:20:462
29815040,0irq/29-eth0-tx-0-21swapper/222:51:242
29815040,0irq/29-eth0-tx-0-21swapper/222:26:102
29815040,0irq/29-eth0-tx-0-21swapper/222:06:302
29815040,0irq/29-eth0-tx-0-21swapper/221:56:012
29815040,0irq/29-eth0-tx-0-21swapper/200:26:042
29815040,0irq/29-eth0-tx-0-21swapper/200:20:582
29805040,0irq/28-eth0-rx-1076-21aten2.4-expect20:45:533
29805040,0irq/28-eth0-rx-0-21swapper/323:51:123
29805040,0irq/28-eth0-rx-0-21swapper/321:46:013
29805040,0irq/28-eth0-rx-0-21swapper/321:06:023
29805040,0irq/28-eth0-rx-0-21swapper/320:58:133
29805040,0irq/28-eth0-rx-0-21swapper/320:31:053
29805040,0irq/28-eth0-rx-0-21swapper/320:20:563
29805040,0irq/28-eth0-rx-0-21swapper/319:35:443
29805040,0irq/28-eth0-rx-0-21swapper/300:35:583
259940,0migration/29931-21kthreadcore19:41:022
259940,0migration/28879-21kthreadcore21:51:022
259940,0migration/25948-21kthreadcore23:41:032
259940,0migration/25819-21kthreadcore20:46:002
259940,0migration/232684-21kthreadcore23:01:022
259940,0migration/231262-21kthreadcore19:56:012
259940,0migration/227262-21kthreadcore21:01:032
259940,0migration/223453-21kthreadcore19:51:032
259940,0migration/221540-21kthreadcore21:21:002
259940,0migration/21804-21kthreadcore20:21:012
259940,0migration/214710-21kthreadcore21:16:012
259940,0migration/212138-21kthreadcore20:06:022
249940,0watchdog/222774-21cat20:15:552
249940,0watchdog/20-21swapper/220:35:552
179940,0migration/19114-21kthreadcore21:11:021
179940,0migration/127029-21irqcore23:36:011
179940,0migration/125611-21kthreadcore00:31:021
179940,0migration/124871-21irqrtprio23:16:011
179940,0migration/123464-21kthreadcore21:21:011
179940,0migration/122920-21fschecks_count19:30:571
179940,0migration/122537-21irqrtprio22:56:011
179940,0migration/119253-21latency_hist23:50:441
179940,0migration/116695-21kthreadcore21:56:021
179940,0migration/116608-21munin-node22:15:561
179940,0migration/113251-21kthreadcore20:51:021
169940,0watchdog/19761-21fschecks_time00:41:001
169940,0watchdog/14938-21ssh00:16:561
169940,0watchdog/127344-21irqcore19:55:591
169940,0watchdog/122278-21ssh00:26:521
169940,0watchdog/115026-21ssh22:12:271
169940,0watchdog/111129-21kthreadcore23:06:041
169940,0watchdog/10-21swapper/123:26:001
169940,0watchdog/10-21swapper/122:05:591
169940,0watchdog/10-21swapper/121:15:551
169940,0watchdog/10-21swapper/120:35:551
169940,0watchdog/10-21swapper/120:11:031
169940,0watchdog/10-21swapper/119:35:591
169940,0watchdog/10-21swapper/100:45:561
149509944,0cyclictest0-21swapper/223:56:102
149509944,0cyclictest0-21swapper/221:11:052
149509944,0cyclictest0-21swapper/200:40:472
149509943,0cyclictest9491-21awk23:25:582
149509943,0cyclictest3571-21lldpd21:06:332
149509943,0cyclictest3571-21lldpd19:46:322
149509943,0cyclictest3571-21lldpd19:31:012
149509943,0cyclictest3571-21lldpd00:46:072
149509943,0cyclictest22143-21awk22:56:002
149509943,0cyclictest17708-21awk22:16:012
149509943,0cyclictest16179-21awk19:25:592
149509943,0cyclictest12637-21awk21:36:002
149509943,0cyclictest11267-21awk22:30:592
149509940,0cyclictest23347-21munin-node23:15:572
149449944,0cyclictest0-21swapper/122:50:511
149449944,0cyclictest0-21swapper/100:06:041
149449944,0cyclictest0-21swapper/100:01:101
149449943,0cyclictest9316-21awk20:06:001
149449943,0cyclictest3785-21awk21:31:001
149449943,0cyclictest3571-21lldpd23:59:371
149449943,0cyclictest3571-21lldpd23:23:061
149449943,0cyclictest3571-21lldpd22:41:351
149449943,0cyclictest3571-21lldpd21:40:341
149449943,0cyclictest3571-21lldpd21:27:331
149449943,0cyclictest3571-21lldpd21:07:031
149449943,0cyclictest3571-21lldpd21:04:331
149449943,0cyclictest3571-21lldpd20:33:021
149449943,0cyclictest3571-21lldpd19:44:321
149449943,0cyclictest3524-21snmpd22:46:011
149449943,0cyclictest3250-21irqbalance23:46:111
149449943,0cyclictest3250-21irqbalance22:31:211
149449943,0cyclictest3250-21irqbalance20:46:101
149449943,0cyclictest3250-21irqbalance20:20:501
149449943,0cyclictest3250-21irqbalance20:16:001
149449943,0cyclictest3250-21irqbalance00:50:511
149449943,0cyclictest3250-21irqbalance00:37:411
149449943,0cyclictest3250-21irqbalance00:21:511
149449943,0cyclictest26397-21grep22:01:031
149449943,0cyclictest25854-21sadc19:55:441
149449943,0cyclictest2571-21awk22:26:011
149449943,0cyclictest25425-21sadc23:35:441
149449943,0cyclictest21504-21awk21:41:011
149449943,0cyclictest19986-21awk22:36:011
149449943,0cyclictest1950-21awk20:00:581
149449943,0cyclictest16209-21awk19:25:591
149449943,0cyclictest12726-21awk19:45:591
149349944,0cyclictest0-21swapper/021:05:500
149349943,0cyclictest6921-21kworker/0:019:41:070
149349943,0cyclictest6622-21awk21:51:000
149349943,0cyclictest5943-21awk21:11:000
149349943,0cyclictest3571-21lldpd19:26:020
149349943,0cyclictest3524-21snmpd21:16:000
149349943,0cyclictest30819-21awk20:20:580
149349943,0cyclictest19923-21awk19:50:590
149349943,0cyclictest18291-21kworker/0:122:53:080
149349943,0cyclictest18291-21kworker/0:122:38:200
149349943,0cyclictest18291-21kworker/0:122:33:000
149349943,0cyclictest18291-21kworker/0:122:28:160
149349943,0cyclictest18291-21kworker/0:121:41:330
149349943,0cyclictest13003-21kworker/0:000:54:080
149349943,0cyclictest13003-21kworker/0:000:38:360
149349943,0cyclictest12736-21awk21:36:010
149349942,0cyclictest13003-21kworker/0:000:45:460
149940,0migration/014754-21kthreadcore20:31:020
29815030,0irq/29-eth0-tx-0-21swapper/019:55:540
29805030,0irq/28-eth0-rx-0-21swapper/319:46:563
249930,0watchdog/20-21swapper/220:11:032
179930,0migration/17968-21kthreadcore20:26:011
179930,0migration/1362-21runrttasks20:41:301
169930,0watchdog/126786-21munin-node22:21:031
149509933,0cyclictest3571-21lldpd20:41:022
149509932,0cyclictest14490-21kthreadcore20:31:022
149509930,0cyclictest0-21swapper/220:51:012
149449932,0cyclictest2789-21ntpdc21:46:041
149449932,0cyclictest21841-21egrep00:10:561
149449932,0cyclictest21769-21sensors20:56:051
149349933,0cyclictest6921-21kworker/0:020:35:450
149349933,0cyclictest6921-21kworker/0:019:30:450
149349933,0cyclictest18291-21kworker/0:100:05:480
329920,0watchdog/30-21swapper/319:25:473
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional