You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-14 - 07:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Thu May 14, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1807525038,0sleep20-21swapper/219:20:592
1786724332,0sleep00-21swapper/019:18:330
1129523828,0sleep30-21swapper/319:17:403
1815523626,0sleep10-21swapper/119:21:551
182909976,0cyclictest5624-21ssh23:37:490
4160,0ktimersoftd/00-21swapper/000:19:490
339960,0migration/38959-21sh00:15:503
339960,0migration/36788-21sh22:42:023
339960,0migration/328586-21sh00:45:583
339960,0migration/325456-21sh00:07:513
339960,0migration/31358-21runrttasks21:59:423
339960,0migration/310430-21sh22:05:403
329960,0watchdog/33287-21needreboot20:37:563
29805060,0irq/28-eth0-rx-21350-21grep00:22:543
29805060,0irq/28-eth0-rx-11106-21iostat00:17:533
29805060,0irq/28-eth0-rx-0-21swapper/321:27:593
19160,0ktimersoftd/10-21swapper/100:19:491
8305050,0irq/26-0000:00:30749-21ssh22:52:582
8305050,0irq/26-0000:00:0-21swapper/221:12:372
339950,0migration/38152-21latency_hist21:07:373
339950,0migration/3715-21diskmemload22:57:453
339950,0migration/33917-21sh23:34:233
339950,0migration/331157-21munin-node21:22:553
339950,0migration/330477-21timerwakeupswit21:38:023
339950,0migration/329976-21kthreadcore00:27:543
339950,0migration/329241-21kthreadcore19:27:543
339950,0migration/324334-21kthreadcore20:32:543
339950,0migration/323194-21fschecks_count23:47:513
339950,0migration/32249-21kthreadcore21:42:553
339950,0migration/322255-21missed_timers00:02:573
339950,0migration/320424-21taskset23:27:493
339950,0migration/318537-21sh00:38:023
339950,0migration/317923-21kthreadcore22:47:553
339950,0migration/317792-21kthreadcore21:32:563
339950,0migration/317487-21missed_timers20:02:543
339950,0migration/317045-21kthreadcore22:27:553
339950,0migration/316637-21munin-node21:12:533
339950,0migration/315236-21taskset21:12:213
339950,0migration/315007-21latency_hist19:42:373
339950,0migration/312496-21munin-node22:07:523
339950,0migration/311484-21kthreadcore22:42:553
329950,0watchdog/329941-21cut20:57:563
329950,0watchdog/328104-21kthreadcore20:12:563
329950,0watchdog/326773-21sh22:13:053
329950,0watchdog/30-21swapper/321:18:003
29815050,0irq/29-eth0-tx-5797-21tr22:02:542
29815050,0irq/29-eth0-tx-4603-21munin-node20:42:550
29815050,0irq/29-eth0-tx-4343-21munin-node19:58:000
29815050,0irq/29-eth0-tx-27880-21ssh00:44:012
29815050,0irq/29-eth0-tx-27553-21ssh22:15:132
29815050,0irq/29-eth0-tx-26755-21munin-node23:12:542
29815050,0irq/29-eth0-tx-25122-21ssh21:54:482
29815050,0irq/29-eth0-tx-11688-21ssh00:37:042
29815050,0irq/29-eth0-tx-0-21swapper/223:57:472
29815050,0irq/29-eth0-tx-0-21swapper/223:52:392
29815050,0irq/29-eth0-tx-0-21swapper/223:30:362
29815050,0irq/29-eth0-tx-0-21swapper/222:58:242
29815050,0irq/29-eth0-tx-0-21swapper/221:37:522
29805050,0irq/28-eth0-rx-8945-21kthreadcore23:37:543
29805050,0irq/28-eth0-rx-7321-21kthreadcore22:22:543
29805050,0irq/28-eth0-rx-6449-21ssh23:55:023
29805050,0irq/28-eth0-rx-30399-21gltestperf00:47:513
29805050,0irq/28-eth0-rx-27086-21df23:12:513
29805050,0irq/28-eth0-rx-17900-21open_files23:22:593
29805050,0irq/28-eth0-rx-10325-21iostat_ios21:47:533
29805050,0irq/28-eth0-rx-10311-21fschecks_time23:02:503
29805050,0irq/28-eth0-rx-0-21swapper/323:58:193
29805050,0irq/28-eth0-rx-0-21swapper/323:07:563
29805050,0irq/28-eth0-rx-0-21swapper/322:52:543
29805050,0irq/28-eth0-rx-0-21swapper/321:52:553
29805050,0irq/28-eth0-rx-0-21swapper/320:00:213
259950,0migration/29708-21latency_hist00:17:382
259950,0migration/27270-21kthreadcore22:22:542
259950,0migration/24101-21timerwakeupswit21:23:042
259950,0migration/232221-21kthreadcore23:32:562
259950,0migration/222290-21switchtime22:48:032
259950,0migration/221337-21sh22:30:442
259950,0migration/219891-21sh23:26:582
259950,0migration/214556-21kthreadcore20:47:552
182989955,0cyclictest0-21swapper/222:45:542
182989955,0cyclictest0-21swapper/221:58:172
182989955,0cyclictest0-21swapper/219:37:492
182989953,0cyclictest3250-21irqbalance21:49:042
182989950,0cyclictest0-21swapper/223:07:402
182989950,0cyclictest0-21swapper/222:32:402
182989950,0cyclictest0-21swapper/200:40:502
182919955,0cyclictest0-21swapper/121:47:531
182919950,0cyclictest0-21swapper/122:20:311
182909955,0cyclictest0-21swapper/022:01:010
182909955,0cyclictest0-21swapper/000:49:050
182909950,0cyclictest0-21swapper/023:17:570
182909950,0cyclictest0-21swapper/022:05:540
182909950,0cyclictest0-21swapper/021:35:100
182909950,0cyclictest0-21swapper/021:23:580
182909950,0cyclictest0-21swapper/000:39:280
182909950,0cyclictest0-21swapper/000:09:020
179950,0migration/16442-21aten_r1power_po21:27:501
179950,0migration/14840-21cpuspeed_turbos20:42:481
179950,0migration/130632-21munin-node00:47:531
179950,0migration/129124-21aten2.4-expect23:32:501
179950,0migration/128800-21switchtime20:33:011
179950,0migration/125775-21aten_r1power_en19:27:471
179950,0migration/12071-21gltestperf00:12:501
179950,0migration/11824-21idleruntime20:17:511
179950,0migration/11824-21idleruntime20:17:511
179950,0migration/114341-21unixbench_singl23:58:051
169950,0watchdog/15112-21awk23:52:571
169950,0watchdog/13290-21needreboot20:37:561
14140250,0sleep314425-21df_abs23:42:493
149950,0migration/032126-21kthreadcore20:37:540
149950,0migration/031457-21sh23:52:490
149950,0migration/028338-21kthreadcore21:17:550
149950,0migration/026533-21kthreadcore20:32:540
149950,0migration/023319-21hwlatdetect22:32:520
149950,0migration/01967-21kthreadcore22:37:550
149950,0migration/019430-21kthreadcore21:52:540
149950,0migration/017263-21kthreadcore21:12:550
149950,0migration/013808-21kthreadcore20:47:550
149950,0migration/013252-21sh21:28:400
149950,0migration/011381-21kthreadcore21:47:540
8305040,0irq/26-0000:00:15979-21munin-node23:03:012
339940,0migration/37728-21taskset20:20:413
339940,0migration/37728-21taskset20:20:413
339940,0migration/330291-21irqstats22:17:543
339940,0migration/312904-21kthreadcore20:22:553
329940,0watchdog/330535-21if_err_eth1.219:52:523
329940,0watchdog/325576-21sshd20:10:203
329940,0watchdog/30-21swapper/320:52:563
329940,0watchdog/30-21swapper/319:37:523
29815040,0irq/29-eth0-tx-31637-21ssh00:08:092
29815040,0irq/29-eth0-tx-0-21swapper/223:49:562
29815040,0irq/29-eth0-tx-0-21swapper/223:17:412
29815040,0irq/29-eth0-tx-0-21swapper/222:37:542
29815040,0irq/29-eth0-tx-0-21swapper/222:07:452
29815040,0irq/29-eth0-tx-0-21swapper/200:47:472
29815040,0irq/29-eth0-tx-0-21swapper/200:27:382
29815040,0irq/29-eth0-tx-0-21swapper/200:17:492
29815040,0irq/29-eth0-tx-0-21swapper/021:07:470
29815040,0irq/29-eth0-tx-0-21swapper/020:27:520
29815040,0irq/29-eth0-tx-0-21swapper/020:17:530
29815040,0irq/29-eth0-tx-0-21swapper/020:17:530
29815040,0irq/29-eth0-tx-0-21swapper/019:22:520
29805040,0irq/28-eth0-rx-0-21swapper/323:18:313
29805040,0irq/28-eth0-rx-0-21swapper/322:32:393
29805040,0irq/28-eth0-rx-0-21swapper/300:32:583
259940,0migration/29408-21kthreadcore20:42:542
259940,0migration/226860-21kthreadcore20:32:542
259940,0migration/223770-21kthreadcore00:22:552
259940,0migration/223444-21fschecks_time21:17:502
259940,0migration/222292-21needreboot00:02:572
259940,0migration/211218-21kthreadcore21:27:572
259940,0migration/210355-21kthreadcore21:07:542
249940,0watchdog/23288-21strings20:37:562
249940,0watchdog/225200-21python20:53:002
249940,0watchdog/212436-21seq23:39:012
182989944,0cyclictest0-21swapper/221:33:322
182989944,0cyclictest0-21swapper/221:04:222
182989943,0cyclictest3571-21lldpd20:02:512
182989943,0cyclictest3571-21lldpd19:44:202
182989943,0cyclictest3250-21irqbalance23:42:442
182989943,0cyclictest3250-21irqbalance20:22:442
182989943,0cyclictest3250-21irqbalance20:17:442
182989943,0cyclictest3250-21irqbalance20:17:442
182989943,0cyclictest3250-21irqbalance20:12:542
182989943,0cyclictest3250-21irqbalance20:08:132
182989943,0cyclictest3250-21irqbalance19:57:532
182989943,0cyclictest3250-21irqbalance19:53:532
182989943,0cyclictest29928-21awk22:17:532
182989943,0cyclictest27294-21awk20:57:542
182989943,0cyclictest16375-21awk20:27:542
182989943,0cyclictest1599-21awk19:32:522
182989943,0cyclictest1550-21awk21:42:532
182919943,0cyclictest4275-21awk23:17:531
182919943,0cyclictest3524-21snmpd23:38:221
182919943,0cyclictest3524-21snmpd22:58:371
182919943,0cyclictest3524-21snmpd21:39:361
182919943,0cyclictest3524-21snmpd21:24:361
182919943,0cyclictest3524-21snmpd20:55:361
182919943,0cyclictest30538-21awk19:52:521
182919943,0cyclictest26008-21awk00:07:531
182919943,0cyclictest23801-21awk23:47:541
182919943,0cyclictest18325-21grep21:52:501
182919943,0cyclictest16345-21awk20:27:541
182919940,0cyclictest0-21swapper/122:28:341
182909944,0cyclictest0-21swapper/023:27:530
182909944,0cyclictest0-21swapper/022:27:020
182909944,0cyclictest0-21swapper/000:02:530
182909943,0cyclictest3571-21lldpd20:22:510
182909943,0cyclictest3571-21lldpd00:15:230
182909943,0cyclictest3524-21snmpd22:18:520
182909943,0cyclictest3250-21irqbalance23:47:540
182909943,0cyclictest3250-21irqbalance23:22:540
182909943,0cyclictest3250-21irqbalance23:07:440
182909943,0cyclictest3250-21irqbalance23:04:040
182909943,0cyclictest3250-21irqbalance22:12:540
182909943,0cyclictest3250-21irqbalance22:10:040
182909943,0cyclictest27342-21awk20:57:540
182909943,0cyclictest25076-21awk21:37:520
182909943,0cyclictest23321-21awk19:47:520
182909943,0cyclictest17062-21awk22:47:540
182909943,0cyclictest15179-21awk23:42:520
182909943,0cyclictest1502-21awk21:42:530
182909943,0cyclictest12638-21awk20:02:510
182909940,0cyclictest26943-21awk00:27:380
182909940,0cyclictest0-21swapper/000:29:510
179940,0migration/17116-21kthreadcore22:22:541
179940,0migration/16955-21timerwakeupswit21:43:031
179940,0migration/15328-21kthreadcore21:02:541
179940,0migration/132019-21munin-node20:12:591
179940,0migration/130414-21kthreadcore20:57:561
179940,0migration/125000-21unixbench_multi19:23:031
179940,0migration/12288-21kthreadcore22:37:551
179940,0migration/120095-21irqcore20:07:541
179940,0migration/119535-21irqcore23:07:551
179940,0migration/119256-21fschecks_time00:22:501
179940,0migration/118394-21kthreadcore00:02:561
179940,0migration/116533-21kthreadcore23:22:551
179940,0migration/114005-21taskset23:42:431
179940,0migration/113213-21kthreadcore22:07:541
179940,0migration/112440-21cpuspeed_turbos00:37:511
179940,0migration/110916-21taskset00:34:541
169940,0watchdog/130896-21python22:53:011
169940,0watchdog/126728-21ssh23:12:451
169940,0watchdog/125924-21grep23:27:571
169940,0watchdog/12312-21ssh00:30:171
169940,0watchdog/122431-21ssh22:32:491
169940,0watchdog/121286-21python19:43:001
169940,0watchdog/11628-21ssh22:00:281
169940,0watchdog/10-21swapper/122:03:571
169940,0watchdog/10-21swapper/119:57:561
149940,0migration/06628-21ntp_offset19:32:570
149940,0migration/05102-21kthreadcore22:57:560
149940,0migration/04216-21fschecks_time00:32:510
149940,0migration/029307-21kthreadcore23:12:550
149940,0migration/029017-21kthreadcore20:12:560
149940,0migration/028534-21kthreadcore22:52:550
149940,0migration/028274-21kthreadcore19:27:540
149940,0migration/026665-21kthreadcore00:42:560
149940,0migration/020373-21vmstat22:28:040
149940,0migration/019508-21fschecks_time20:07:510
149940,0migration/01832-21kthreadcore19:52:550
149940,0migration/014077-21swap19:38:020
149940,0migration/010265-21kthreadcore22:42:550
8305030,0irq/26-0000:00:0-21swapper/319:23:003
329930,0watchdog/30-21swapper/320:42:523
329930,0watchdog/30-21swapper/320:27:563
329930,0watchdog/30-21swapper/319:48:043
29815030,0irq/29-eth0-tx-1024-21aten2.4-expect21:02:470
29815030,0irq/29-eth0-tx-0-21swapper/019:42:480
29805030,0irq/28-eth0-rx-0-21swapper/320:47:503
29805030,0irq/28-eth0-rx-0-21swapper/319:32:483
182989932,0cyclictest3571-21lldpd19:48:502
182989932,0cyclictest26772-21awk19:27:522
182989932,0cyclictest19580-21awk19:22:522
182919932,0cyclictest3571-21lldpd21:17:511
182919932,0cyclictest3571-21lldpd20:23:511
182919932,0cyclictest3524-21snmpd22:50:221
182919932,0cyclictest28474-21sensors19:47:591
182919932,0cyclictest21710-21sensors21:13:001
182919932,0cyclictest12100-21expr20:47:501
182919930,0cyclictest12010-21diskstats20:02:481
182909932,0cyclictest7847-21basename23:57:510
182909932,0cyclictest3571-21lldpd23:35:530
182909930,0cyclictest18989-21munin-node20:52:590
179930,0migration/111539-21kthreadcore23:02:541
169930,0watchdog/120224-21kthreadcore21:32:561
169930,0watchdog/10-21swapper/122:42:411
169930,0watchdog/10-21swapper/122:13:051
169930,0watchdog/10-21swapper/121:08:281
169930,0watchdog/10-21swapper/119:37:481
169930,0watchdog/10-21swapper/100:42:531
169920,0watchdog/10-21swapper/119:32:441
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional