You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 01:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue Jul 14, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2365624940,0sleep20-21swapper/219:23:092
1713124140,0sleep00-21swapper/019:22:470
2371323523,0sleep10-21swapper/119:23:481
2368323026,0sleep30-21swapper/319:23:263
241109988,0cyclictest3524-21snmpd20:22:210
29805070,0irq/28-eth0-rx-0-21swapper/320:08:453
35160,0ktimersoftd/30-21swapper/320:02:373
339960,0migration/327394-21sh21:38:193
339960,0migration/326765-21sh22:34:343
339960,0migration/325580-21sh23:30:533
339960,0migration/316297-21sh23:24:063
339960,0migration/315210-21irqrtprio00:02:543
339960,0migration/311532-21sh00:56:383
29805060,0irq/28-eth0-rx-4043-21cut22:57:553
29805060,0irq/28-eth0-rx-22818-21df00:07:493
29805060,0irq/28-eth0-rx-20036-21cat20:52:533
29805060,0irq/28-eth0-rx-0-21swapper/300:20:363
259960,0migration/24064-21fschecks_count00:52:512
241129965,0cyclictest0-21swapper/221:46:432
241109960,0cyclictest0-21swapper/020:47:580
149960,0migration/019218-21kthreadcore20:52:530
149960,0migration/014889-21kthreadcore22:47:540
8305050,0irq/26-0000:00:2471-21kauditd22:07:372
662250,0sleep0671-21ssh22:19:340
662250,0sleep0671-21ssh22:19:340
339950,0migration/36533-21kthreadcore19:57:553
339950,0migration/35752-21munin-node19:33:023
339950,0migration/332567-21fschecks_time21:02:513
339950,0migration/330228-21kthreadcore21:22:543
339950,0migration/328437-21munin-node19:52:493
339950,0migration/327805-21taskset21:19:083
339950,0migration/325726-21latency_hist22:17:373
339950,0migration/325726-21latency_hist22:17:373
339950,0migration/325599-21fschecks_time00:27:523
339950,0migration/32545-21kthreadcore22:02:543
339950,0migration/325182-21kthreadcore20:32:563
339950,0migration/318792-21sh21:33:553
339950,0migration/31739-21kthreadcore20:17:553
339950,0migration/311954-21kthreadcore00:37:533
339950,0migration/31119-21aten_r1power_fr00:32:483
339950,0migration/310417-21kthreadcore20:22:563
329950,0watchdog/3944-21kthreadcore20:37:553
329950,0watchdog/36495-21mdstat23:17:563
329950,0watchdog/310241-21cut21:07:553
329950,0watchdog/30-21swapper/321:42:523
329950,0watchdog/30-21swapper/320:47:553
29815050,0irq/29-eth0-tx-371-21munin-node23:17:542
29815050,0irq/29-eth0-tx-3187-21ssh21:27:460
29815050,0irq/29-eth0-tx-24321-21munin-node19:28:010
29815050,0irq/29-eth0-tx-19528-21munin-node22:33:042
29815050,0irq/29-eth0-tx-19464-21kthreadcore23:27:552
29815050,0irq/29-eth0-tx-14034-21ssh21:51:142
29815050,0irq/29-eth0-tx-0-21swapper/200:43:002
29815050,0irq/29-eth0-tx-0-21swapper/200:07:392
29815050,0irq/29-eth0-tx-0-21swapper/019:47:150
29815050,0irq/29-eth0-tx-0-21swapper/019:37:530
29805050,0irq/28-eth0-rx-6944-21ssh00:16:573
29805050,0irq/28-eth0-rx-6523-21cut21:27:543
29805050,0irq/28-eth0-rx-6322-21tr23:37:553
29805050,0irq/28-eth0-rx-5775-21fschecks_time23:57:503
29805050,0irq/28-eth0-rx-30467-21rt-features23:13:003
29805050,0irq/28-eth0-rx-29924-21if_eth023:52:533
29805050,0irq/28-eth0-rx-21502-21missed_timers23:07:563
29805050,0irq/28-eth0-rx-0-21swapper/323:47:563
29805050,0irq/28-eth0-rx-0-21swapper/323:33:133
29805050,0irq/28-eth0-rx-0-21swapper/323:02:543
29805050,0irq/28-eth0-rx-0-21swapper/322:27:513
29805050,0irq/28-eth0-rx-0-21swapper/322:23:573
29805050,0irq/28-eth0-rx-0-21swapper/322:01:043
29805050,0irq/28-eth0-rx-0-21swapper/321:52:583
29805050,0irq/28-eth0-rx-0-21swapper/320:27:523
29805050,0irq/28-eth0-rx-0-21swapper/300:50:063
29805050,0irq/28-eth0-rx-0-21swapper/300:23:483
27150,0ktimersoftd/20-21swapper/200:20:362
259950,0migration/231561-21kthreadcore00:47:552
259950,0migration/229584-21fschecks_time23:52:512
259950,0migration/229506-21missed_timers21:57:562
259950,0migration/227140-21pmu-power20:32:592
259950,0migration/226279-21open_files23:47:582
259950,0migration/224401-21aten_r1power_fr19:27:462
259950,0migration/223082-21latency22:12:572
241129955,0cyclictest0-21swapper/222:19:212
241129955,0cyclictest0-21swapper/222:19:212
241129955,0cyclictest0-21swapper/200:36:122
241129955,0cyclictest0-21swapper/200:24:512
241129950,0cyclictest0-21swapper/222:56:532
241129950,0cyclictest0-21swapper/221:37:542
241129950,0cyclictest0-21swapper/200:14:462
241109955,0cyclictest0-21swapper/022:25:340
241109950,0cyclictest0-21swapper/000:36:540
249950,0watchdog/230697-21timerwakeupswit23:13:042
249950,0watchdog/228346-21munin-node21:22:592
249950,0watchdog/220736-21kthreadcore20:07:552
249950,0watchdog/215461-21kthreadcore23:42:562
249950,0watchdog/20-21swapper/222:48:082
179950,0migration/129446-21kthreadcore23:32:551
179950,0migration/12813-21latency_hist19:57:361
179950,0migration/12225-21timerwakeupswit20:38:021
179950,0migration/111648-21kthreadcore22:07:551
179950,0migration/11039-21kthreadcore19:32:541
169950,0watchdog/129838-21python21:58:001
169950,0watchdog/120738-21kthreadcore20:07:551
149950,0migration/09661-21sh23:38:240
149950,0migration/09200-21kthreadcore23:02:530
149950,0migration/06627-21taskset20:22:440
149950,0migration/06616-21fschecks_time21:47:490
149950,0migration/05630-21munin-node22:42:530
149950,0migration/03626-21kthreadcore23:17:550
149950,0migration/032270-21kthreadcore20:37:550
149950,0migration/032071-21gltestperf00:12:520
149950,0migration/031430-21taskset20:17:000
149950,0migration/03133-21kthreadcore22:02:540
149950,0migration/030599-21missed_timers20:57:560
149950,0migration/028602-21kthreadcore00:27:560
149950,0migration/026637-21taskset22:34:130
149950,0migration/022645-21kthreadcore21:37:560
149950,0migration/022356-21sh00:23:020
149950,0migration/020395-21kthreadcore23:27:540
149950,0migration/020362-21kthreadcore22:12:560
149950,0migration/019081-21kthreadcore21:52:550
149950,0migration/018939-21kthreadcore00:02:550
149950,0migration/01889-21munin-node22:37:580
149950,0migration/016045-21kthreadcore22:27:550
149950,0migration/015480-21kthreadcore00:37:540
149950,0migration/011541-21switchtime23:58:020
149950,0migration/011248-21sh00:55:510
149950,0migration/010305-21aten_r1power_vo20:02:490
12608250,0sleep312613-21ssh22:46:483
339940,0migration/3585-21kthreadcore22:37:553
339940,0migration/324061-21kthreadcore19:47:553
339940,0migration/314699-21fschecks_time21:12:503
329940,0watchdog/30-21swapper/322:47:443
329940,0watchdog/30-21swapper/322:12:563
329940,0watchdog/30-21swapper/322:07:563
329940,0watchdog/30-21swapper/321:47:523
329940,0watchdog/30-21swapper/320:57:553
29815040,0irq/29-eth0-tx-30431-21ssh22:57:382
29815040,0irq/29-eth0-tx-0-21swapper/223:57:452
29815040,0irq/29-eth0-tx-0-21swapper/223:37:492
29815040,0irq/29-eth0-tx-0-21swapper/223:08:072
29815040,0irq/29-eth0-tx-0-21swapper/222:37:462
29815040,0irq/29-eth0-tx-0-21swapper/222:22:402
29815040,0irq/29-eth0-tx-0-21swapper/222:07:522
29815040,0irq/29-eth0-tx-0-21swapper/221:52:502
29815040,0irq/29-eth0-tx-0-21swapper/221:32:392
29815040,0irq/29-eth0-tx-0-21swapper/200:37:422
29815040,0irq/29-eth0-tx-0-21swapper/200:27:472
29815040,0irq/29-eth0-tx-0-21swapper/021:12:560
29815040,0irq/29-eth0-tx-0-21swapper/021:02:560
29815040,0irq/29-eth0-tx-0-21swapper/019:47:490
29805040,0irq/28-eth0-rx-0-21swapper/323:42:563
29805040,0irq/28-eth0-rx-0-21swapper/322:52:583
29805040,0irq/28-eth0-rx-0-21swapper/300:42:453
259940,0migration/29132-21kthreadcore23:02:532
259940,0migration/25183-21kthreadcore20:42:542
259940,0migration/232192-21cpuspeed_turbos21:02:502
259940,0migration/226430-21latency_hist23:32:372
259940,0migration/224615-21kthreadcore21:17:562
259940,0migration/222352-21kernelversion19:47:542
259940,0migration/219996-21pmu-power21:12:582
259940,0migration/217932-21kthreadcore00:02:552
259940,0migration/214638-21kthreadcore23:22:552
241129943,0cyclictest3524-21snmpd22:42:382
241129943,0cyclictest3524-21snmpd21:28:222
241129943,0cyclictest3524-21snmpd20:48:072
241129943,0cyclictest3524-21snmpd20:40:512
241129943,0cyclictest3524-21snmpd20:31:362
241129943,0cyclictest3524-21snmpd20:20:062
241129943,0cyclictest3524-21snmpd20:14:362
241129943,0cyclictest3524-21snmpd19:57:512
241129943,0cyclictest29200-21awk19:52:532
241129943,0cyclictest11253-21awk20:02:532
241119943,0cyclictest8019-21awk23:02:521
241119943,0cyclictest8007-21tail21:07:541
241119943,0cyclictest7015-21awk21:47:511
241119943,0cyclictest4294-21awk20:42:531
241119943,0cyclictest3524-21snmpd23:24:081
241119943,0cyclictest3524-21snmpd21:43:521
241119943,0cyclictest3524-21snmpd19:27:501
241119943,0cyclictest3524-21snmpd00:17:241
241119943,0cyclictest3524-21snmpd00:07:391
241119943,0cyclictest32172-21grep20:17:511
241119943,0cyclictest24444-21sadc20:57:361
241119943,0cyclictest19061-21awk23:27:531
241109944,0cyclictest0-21swapper/023:42:400
241109944,0cyclictest0-21swapper/023:24:220
241109944,0cyclictest0-21swapper/021:07:500
241109943,0cyclictest3571-21lldpd00:10:030
241109943,0cyclictest29080-21awk19:52:520
241109943,0cyclictest28354-21awk00:47:530
249940,0watchdog/219808-21python19:42:592
249940,0watchdog/218667-21if_eth1.320:52:512
249940,0watchdog/210775-21ssh22:27:402
249940,0watchdog/20-21swapper/221:07:552
249940,0watchdog/20-21swapper/220:57:552
249940,0watchdog/20-21swapper/220:22:512
179940,0migration/19992-21runrttasks21:28:151
179940,0migration/18195-21kthreadcore00:52:561
179940,0migration/17411-21latency_hist00:17:371
179940,0migration/15916-21fschecks_time23:57:501
179940,0migration/15258-21fschecks_time22:42:511
179940,0migration/13446-21taskset23:53:551
179940,0migration/132749-21latency_hist23:17:361
179940,0migration/131586-21latency_hist20:17:361
179940,0migration/129440-21taskset22:55:351
179940,0migration/128726-21irqrtprio00:47:541
179940,0migration/12823-21fschecks_time22:22:511
179940,0migration/126771-21needreboot19:47:571
179940,0migration/126237-21ntp_kernel_err23:47:571
179940,0migration/124189-21aten_r1power_cu23:12:491
179940,0migration/121992-21timerandwakeup23:08:021
179940,0migration/121941-21kthreadcore00:42:571
179940,0migration/118680-21runrttasks21:33:361
179940,0migration/117594-21kthreadcore20:27:531
179940,0migration/116856-21kthreadcore00:02:551
179940,0migration/116807-21runrttasks20:04:091
179940,0migration/114848-21kthreadcore22:47:541
179940,0migration/114211-21cpuspeed_turbos21:12:491
179940,0migration/113412-21kthreadcore22:27:551
179940,0migration/112304-21kthreadcore00:37:531
169940,0watchdog/18163-21ssh22:07:241
169940,0watchdog/16314-21runrttasks23:46:561
169940,0watchdog/13746-21cut21:02:551
169940,0watchdog/13563-21ssh22:40:521
169940,0watchdog/129779-21kthreadcore20:57:551
169940,0watchdog/1277002sleep121:18:071
169940,0watchdog/124195-21kthreadcore20:32:551
169940,0watchdog/116139-21ssh00:22:481
169940,0watchdog/114707-21kthreadcore20:47:551
169940,0watchdog/10-21swapper/122:57:561
169940,0watchdog/10-21swapper/121:42:001
169940,0watchdog/10-21swapper/119:42:591
149940,0migration/04240-21sh23:56:000
149940,0migration/032470-21kthreadcore21:22:550
149940,0migration/030602-21switchtime23:13:040
149940,0migration/029573-21sh22:55:570
149940,0migration/023731-21kthreadcore20:32:550
149940,0migration/01840-21runrttasks23:35:570
149940,0migration/014272-21kthreadcore22:07:560
8305030,0irq/26-0000:00:0-21swapper/219:37:362
329930,0watchdog/30-21swapper/319:42:553
329930,0watchdog/30-21swapper/319:37:513
29815030,0irq/29-eth0-tx-0-21swapper/020:42:550
29805030,0irq/28-eth0-rx-0-21swapper/320:42:493
241119933,0cyclictest0-21swapper/119:40:111
241119932,0cyclictest3524-21snmpd19:52:511
241119932,0cyclictest26276-21cut00:27:551
241119932,0cyclictest16003-21awk21:52:531
241119930,0cyclictest3722-21perl23:37:511
241109933,0cyclictest0-21swapper/023:50:320
241109932,0cyclictest3524-21snmpd21:57:380
241109932,0cyclictest2848-21munin-node19:57:570
241109932,0cyclictest27329-21sensors21:18:000
241109932,0cyclictest17170-21kthreadcore20:27:520
241109932,0cyclictest14347-21tr21:32:560
241109931,0cyclictest0-21swapper/019:36:490
241109930,0cyclictest30353-21cat22:57:360
241109930,0cyclictest16304-21perl23:07:500
241109930,0cyclictest0-21swapper/020:07:500
249930,0watchdog/20-21swapper/219:33:232
179930,0migration/17934-21irqcore20:22:551
169930,0watchdog/11410-21kthreadcore21:22:551
169930,0watchdog/10-21swapper/122:32:561
169930,0watchdog/10-21swapper/122:17:521
169930,0watchdog/10-21swapper/122:17:521
169930,0watchdog/10-21swapper/122:12:561
169930,0watchdog/10-21swapper/100:32:401
149930,0migration/026019-21sh00:45:150
329920,0watchdog/30-21swapper/320:12:393
329920,0watchdog/30-21swapper/319:27:393
241109921,0cyclictest0-21swapper/021:42:470
241109920,0cyclictest0-21swapper/000:17:370
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional