You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 10:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Sat Dec 20, 2025 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2593924938,0sleep30-21swapper/319:07:373
2618623026,0sleep20-21swapper/219:10:292
2590123026,0sleep00-21swapper/019:07:060
2584322925,0sleep10-21swapper/119:06:271
8305060,0irq/26-0000:00:1282-21dump-pmu-power20:00:362
339960,0migration/332638-21sh23:30:253
29815060,0irq/29-eth0-tx-5577-21crond21:10:360
29805060,0irq/28-eth0-rx-6815-21ssh22:01:353
29805060,0irq/28-eth0-rx-31168-21diskstats22:35:513
29805060,0irq/28-eth0-rx-29639-21diskstats23:10:513
29805060,0irq/28-eth0-rx-2896-21taskset21:41:153
29805060,0irq/28-eth0-rx-15972-21munin-node23:35:583
29805060,0irq/28-eth0-rx-0-21swapper/322:05:593
29805060,0irq/28-eth0-rx-0-21swapper/300:16:103
262679960,0cyclictest0-21swapper/222:30:092
262669965,0cyclictest3524-21snmpd00:23:501
262659966,0cyclictest17098-21ssh22:09:250
149960,0migration/06548-21kthreadcore23:50:530
149960,0migration/05409-21sh23:15:090
149960,0migration/030900-21kthreadcore19:55:550
149960,0migration/030314-21sh21:56:590
149960,0migration/02069-21sh22:17:590
35150,0ktimersoftd/30-21swapper/322:54:403
339950,0migration/39956-21munin-node22:20:573
339950,0migration/3752-21kthreadcore23:45:573
339950,0migration/3516-21switchtime19:56:023
339950,0migration/34096-21needreboot20:20:563
339950,0migration/330111-21ksmtuned20:18:573
339950,0migration/323656-21kthreadcore22:30:553
339950,0migration/323418-21kthreadcore23:05:543
339950,0migration/320605-21munin-node19:50:523
339950,0migration/320541-21diskmemload21:35:543
339950,0migration/318771-21taskset23:02:563
339950,0migration/318149-21munin-node22:10:503
339950,0migration/315060-21smart_sda20:06:003
339950,0migration/313909-21diskmemload23:55:483
339950,0migration/313563-21diskmemload23:18:033
339950,0migration/312538-21cpuspeed_turbos19:45:503
339950,0migration/311244-21if_err_eth021:30:533
339950,0migration/310448-21mdstat23:50:553
329950,0watchdog/317303-21grep22:25:563
329950,0watchdog/313456-21tune2fs20:30:513
29815050,0irq/29-eth0-tx-8874-21munin-node22:05:492
29815050,0irq/29-eth0-tx-2918-21ssh22:19:522
29815050,0irq/29-eth0-tx-28182-21df_inode23:45:512
29815050,0irq/29-eth0-tx-23618-21munin-node21:00:540
29815050,0irq/29-eth0-tx-22560-21perl22:30:522
29815050,0irq/29-eth0-tx-15818-21ssh00:12:472
29815050,0irq/29-eth0-tx-0-21swapper/223:31:002
29815050,0irq/29-eth0-tx-0-21swapper/223:25:072
29805050,0irq/28-eth0-rx-9287-21ssh23:35:153
29805050,0irq/28-eth0-rx-28246-21kthreadcore21:55:553
29805050,0irq/28-eth0-rx-26438-21kthreadcore21:20:533
29805050,0irq/28-eth0-rx-24633-21cut00:35:553
29805050,0irq/28-eth0-rx-2393-21cpu22:55:513
29805050,0irq/28-eth0-rx-21937-21ssh21:16:563
29805050,0irq/28-eth0-rx-21549-21ssh21:52:353
29805050,0irq/28-eth0-rx-19110-21ssh00:31:393
29805050,0irq/28-eth0-rx-19062-21kthreadcore23:20:553
29805050,0irq/28-eth0-rx-17256-21fschecks_time22:45:503
29805050,0irq/28-eth0-rx-1045-21kthreadcore21:05:553
29805050,0irq/28-eth0-rx-0-21swapper/321:45:553
29805050,0irq/28-eth0-rx-0-21swapper/321:27:013
29805050,0irq/28-eth0-rx-0-21swapper/321:11:043
29805050,0irq/28-eth0-rx-0-21swapper/319:30:483
29805050,0irq/28-eth0-rx-0-21swapper/300:23:463
29805050,0irq/28-eth0-rx-0-21swapper/300:10:553
29805050,0irq/28-eth0-rx-0-21swapper/300:08:453
29805050,0irq/28-eth0-rx-0-21swapper/300:00:453
262679955,0cyclictest0-21swapper/222:55:512
262679955,0cyclictest0-21swapper/221:32:172
262679955,0cyclictest0-21swapper/200:31:522
262679955,0cyclictest0-21swapper/200:19:152
262679955,0cyclictest0-21swapper/200:06:382
262679950,0cyclictest0-21swapper/223:28:292
262679950,0cyclictest0-21swapper/222:49:042
262669955,0cyclictest0-21swapper/100:36:031
262659955,0cyclictest0-21swapper/020:05:590
262659955,0cyclictest0-21swapper/019:36:010
262659951,0cyclictest19644-21awk20:35:360
259950,0migration/27383-21kthreadcore21:45:542
259950,0migration/27125-21if_eth1.223:15:562
259950,0migration/26088-21kthreadcore22:20:522
259950,0migration/223962-21kthreadcore23:05:542
259950,0migration/222866-21munin-node00:00:522
259950,0migration/21765-21cpuspeed_turbos20:00:492
249950,0watchdog/228931-21kthreadcore21:00:552
249950,0watchdog/218202-21kthreadcore21:50:552
249950,0watchdog/213181-21expr19:45:512
249950,0watchdog/20-21swapper/221:35:392
249950,0watchdog/20-21swapper/220:55:552
179950,0migration/18314-21fschecks_time22:40:511
179950,0migration/125235-21timerandwakeup23:41:031
179950,0migration/118159-21cpuspeed_turbos22:10:501
149950,0migration/07788-21sh21:26:170
149950,0migration/07065-21sh22:02:070
149950,0migration/03848-21kthreadcore19:15:550
149950,0migration/028919-21kthreadcore22:50:530
149950,0migration/027109-21kthreadcore22:30:560
149950,0migration/026188-21kthreadcore00:00:570
149950,0migration/02445-21sh23:46:500
149950,0migration/023276-21sh23:24:410
149950,0migration/021661-21kthreadcore19:50:530
149950,0migration/020705-21timerwakeupswit21:51:030
149950,0migration/019168-21sh00:31:460
149950,0migration/018198-21cpuspeed_turbos22:10:500
149950,0migration/015311-21kthreadcore23:55:530
149950,0migration/015009-21kthreadcore19:45:550
149950,0migration/01303-21kthreadcore00:05:550
149950,0migration/011482-21pmu-power20:25:570
149950,0migration/010169-21sh21:30:480
10087250,0sleep010093-21rm00:26:380
339940,0migration/39288-21fschecks_time19:20:483
339940,0migration/37309-21latency_hist22:40:373
339940,0migration/32986-21diskmemload00:25:463
339940,0migration/327298-21cpuspeed_turbos20:40:473
339940,0migration/325419-21kthreadcore21:00:543
339940,0migration/32314-21kthreadcore19:35:563
339940,0migration/319620-21kthreadcore20:55:563
339940,0migration/318887-21kthreadcore19:25:543
329940,0watchdog/36314-21runrttasks19:44:473
329940,0watchdog/30-21swapper/323:40:523
29815040,0irq/29-eth0-tx-32156-21munin-node22:00:582
29815040,0irq/29-eth0-tx-23152-21munin-node21:55:502
29815040,0irq/29-eth0-tx-16460-21telnet20:55:500
29815040,0irq/29-eth0-tx-16441-21cut23:55:532
29815040,0irq/29-eth0-tx-0-21swapper/223:51:122
29815040,0irq/29-eth0-tx-0-21swapper/223:00:452
29815040,0irq/29-eth0-tx-0-21swapper/222:50:452
29815040,0irq/29-eth0-tx-0-21swapper/222:10:492
29815040,0irq/29-eth0-tx-0-21swapper/221:41:072
29815040,0irq/29-eth0-tx-0-21swapper/221:15:422
29815040,0irq/29-eth0-tx-0-21swapper/200:35:392
29815040,0irq/29-eth0-tx-0-21swapper/021:10:450
29815040,0irq/29-eth0-tx-0-21swapper/020:41:010
29815040,0irq/29-eth0-tx-0-21swapper/019:25:560
29815040,0irq/29-eth0-tx-0-21swapper/019:10:560
29805040,0irq/28-eth0-rx-0-21swapper/322:15:483
29805040,0irq/28-eth0-rx-0-21swapper/320:45:543
29805040,0irq/28-eth0-rx-0-21swapper/320:35:553
29805040,0irq/28-eth0-rx-0-21swapper/320:10:543
29805040,0irq/28-eth0-rx-0-21swapper/319:15:493
262679943,0cyclictest3571-21lldpd19:40:562
262679943,0cyclictest3571-21lldpd19:37:262
262679943,0cyclictest3571-21lldpd19:22:262
262679943,0cyclictest3524-21snmpd20:52:492
262679943,0cyclictest3250-21irqbalance23:35:432
262679943,0cyclictest32018-21awk21:05:532
262669944,0cyclictest0-21swapper/121:47:501
262669943,0cyclictest5608-21awk23:50:521
262669943,0cyclictest3571-21lldpd23:27:281
262669943,0cyclictest3524-21snmpd23:15:501
262669943,0cyclictest3524-21snmpd23:11:501
262669943,0cyclictest3524-21snmpd22:51:501
262669943,0cyclictest3524-21snmpd22:26:201
262669943,0cyclictest3524-21snmpd22:04:491
262669943,0cyclictest3524-21snmpd21:55:491
262669943,0cyclictest3524-21snmpd21:22:491
262669943,0cyclictest3524-21snmpd21:19:491
262669943,0cyclictest3524-21snmpd19:50:481
262669943,0cyclictest3524-21snmpd19:46:331
262669943,0cyclictest3524-21snmpd19:36:331
262669943,0cyclictest3524-21snmpd19:31:481
262669943,0cyclictest3524-21snmpd19:13:481
262669943,0cyclictest31945-21awk21:05:531
262669943,0cyclictest31804-21awk22:35:531
262669943,0cyclictest27752-21awk19:55:521
262669943,0cyclictest21428-21awk23:05:531
262669943,0cyclictest11904-21tail00:10:551
262669943,0cyclictest10000-21awk20:05:531
262669940,0cyclictest0-21swapper/121:29:231
262669940,0cyclictest0-21swapper/100:32:441
262659944,0cyclictest0-21swapper/022:27:240
262659943,0cyclictest4757-21awk22:20:500
262659943,0cyclictest3524-21snmpd20:39:490
262659943,0cyclictest3524-21snmpd19:44:180
262659943,0cyclictest3524-21snmpd19:20:480
262659943,0cyclictest31646-21awk20:20:530
262659943,0cyclictest30857-21kworker/0:221:48:360
262659943,0cyclictest25111-21awk23:25:540
262659943,0cyclictest24295-21awk20:15:530
262659943,0cyclictest19816-21awk23:40:530
262659940,0cyclictest0-21swapper/023:39:550
262659940,0cyclictest0-21swapper/022:49:280
262659940,0cyclictest0-21swapper/022:36:230
262659940,0cyclictest0-21swapper/000:40:180
259940,0migration/27079-21kthreadcore20:45:542
259940,0migration/26437-21kthreadcore21:25:552
259940,0migration/23955-21fschecks_time00:25:512
259940,0migration/230824-21aten_r1power_fr22:35:502
259940,0migration/229329-21kthreadcore00:20:572
259940,0migration/229265-21aten_r1power_en23:10:492
259940,0migration/229234-21switchtime19:31:012
259940,0migration/225940-21munin-node20:35:582
259940,0migration/224979-21kthreadcore19:50:542
259940,0migration/223867-21fschecks_count20:15:522
259940,0migration/219690-21kthreadcore19:25:542
259940,0migration/217058-21idleruntime20:10:512
259940,0migration/215535-21kthreadcore20:30:552
249940,0watchdog/29632-21grep20:05:512
249940,0watchdog/224006-21ssh21:20:432
249940,0watchdog/219493-21tune2fs23:40:522
249940,0watchdog/211783-21memory21:10:552
249940,0watchdog/211034-21kthreadcore22:40:562
179940,0migration/16327-21kthreadcore23:30:561
179940,0migration/14985-21taskset20:23:461
179940,0migration/13242-21idleruntime22:55:531
179940,0migration/129196-21missed_timers20:15:571
179940,0migration/128160-21munin-node22:15:531
179940,0migration/127082-21aten_r1power_cu20:40:451
179940,0migration/125869-21sh00:20:051
179940,0migration/125062-21kthreadcore22:30:551
179940,0migration/122090-21kthreadcore20:55:561
179940,0migration/122059-21kthreadcore22:45:551
179940,0migration/120847-21runrttasks21:51:031
179940,0migration/117330-21kernelversion19:25:531
179940,0migration/116389-21sh22:07:481
179940,0migration/115024-21aten_r1power_en23:20:481
179940,0migration/113791-21kthreadcore23:35:551
179940,0migration/113517-21kthreadcore20:50:531
179940,0migration/111651-21sensors_volt20:25:581
179940,0migration/110425-21kthreadcore19:20:511
169940,0watchdog/13560-21kthreadcore00:05:561
169940,0watchdog/12163-21ntp_offset21:40:551
169940,0watchdog/117542-21munin-node23:01:001
149940,0migration/07166-21kthreadcore20:00:550
149940,0migration/014794-21sh22:42:240
329930,0watchdog/30-21swapper/320:50:393
329930,0watchdog/30-21swapper/320:01:193
329930,0watchdog/30-21swapper/319:10:473
29815030,0irq/29-eth0-tx-0-21swapper/020:50:470
29805030,0irq/28-eth0-rx-0-21swapper/320:26:213
262679932,0cyclictest3524-21snmpd20:26:492
262679932,0cyclictest31598-21awk20:20:532
262679932,0cyclictest30517-21cut20:40:522
262679932,0cyclictest27603-21awk19:10:502
262669932,0cyclictest8075-21port_sshpriv20:45:571
262669932,0cyclictest6909-21awk21:10:521
262669932,0cyclictest3910-21df22:20:471
262669932,0cyclictest3524-21snmpd20:12:481
262669932,0cyclictest3524-21snmpd19:40:481
262669932,0cyclictest3524-21snmpd19:15:481
262669932,0cyclictest3524-21snmpd00:25:501
262669932,0cyclictest28091-21df_abs23:45:511
262669932,0cyclictest2635-21if_eth120:00:521
262669932,0cyclictest24292-21perl21:00:511
262669932,0cyclictest23471-21gltestperf00:00:531
262669932,0cyclictest20629-21iostat21:35:541
262669932,0cyclictest20625-21perl20:35:511
262669932,0cyclictest15076-21irqstats23:55:521
262669932,0cyclictest10523-21df_abs21:30:501
262659933,0cyclictest32587-21kworker/0:100:20:380
262659933,0cyclictest32587-21kworker/0:100:15:400
262659933,0cyclictest32587-21kworker/0:100:10:440
262659933,0cyclictest30857-21kworker/0:221:35:380
262659933,0cyclictest30857-21kworker/0:221:20:380
262659933,0cyclictest30857-21kworker/0:221:15:420
262659933,0cyclictest25462-21kworker/0:023:15:460
262659933,0cyclictest25462-21kworker/0:023:00:420
262659933,0cyclictest25462-21kworker/0:022:55:440
262659933,0cyclictest24972-21kworker/0:223:30:440
262659933,0cyclictest15531-21kworker/0:020:10:410
262659933,0cyclictest1257-21kworker/0:019:30:390
262659932,0cyclictest21329-21awk23:05:520
262659932,0cyclictest1014-21cut21:40:540
262659930,0cyclictest1846-21munin-node20:45:490
249930,0watchdog/20-21swapper/219:15:552
169930,0watchdog/10-21swapper/120:30:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional