You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 10:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Thu Jul 02, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2919323728,0sleep20-21swapper/219:23:442
2915123723,0sleep00-21swapper/019:23:100
2940023627,0sleep30-21swapper/319:26:053
2929623223,0sleep10-21swapper/119:24:551
339960,0migration/330567-21sh23:28:283
339960,0migration/317870-21sh22:26:533
29815060,0irq/29-eth0-tx-32194-21sed23:47:032
29805060,0irq/28-eth0-rx-25049-21cut00:41:563
29805060,0irq/28-eth0-rx-21460-21perl21:51:533
29805060,0irq/28-eth0-rx-14692-21date00:36:383
29805060,0irq/28-eth0-rx-10638-21ntp_states19:31:583
29805060,0irq/28-eth0-rx-0-21swapper/322:18:263
295159960,0cyclictest0-21swapper/121:31:581
295149960,0cyclictest0-21swapper/022:27:320
295149960,0cyclictest0-21swapper/000:07:200
179960,0migration/126993-21irqrtprio23:46:541
149960,0migration/07888-21sh00:50:320
149960,0migration/04388-21sh23:12:590
149960,0migration/028264-21sh23:08:360
149960,0migration/021096-21sh22:07:150
339950,0migration/39762-21kthreadcore00:11:573
339950,0migration/39719-21sh23:55:063
339950,0migration/39517-21kthreadcore21:01:563
339950,0migration/36033-21taskset23:16:483
339950,0migration/35768-21aten_r1power_po22:01:493
339950,0migration/34124-21taskset19:28:543
339950,0migration/34092-21munin-node21:41:553
339950,0migration/330562-21fschecks_count00:26:533
339950,0migration/329778-21taskset20:55:003
339950,0migration/328625-21idleruntime22:51:533
339950,0migration/328521-21kthreadcore22:31:553
339950,0migration/328147-21diskmemload00:06:503
339950,0migration/327803-21kernelversion21:36:523
339950,0migration/32764-21kthreadcore20:56:563
339950,0migration/325975-21turbostat19:46:383
339950,0migration/321318-21munin-node23:22:043
339950,0migration/320712-21switchtime22:07:043
339950,0migration/319050-21taskset21:09:263
339950,0migration/318185-21kthreadcore20:01:553
339950,0migration/317517-21kthreadcore00:36:563
339950,0migration/317121-21kthreadcore20:21:543
339950,0migration/313026-21irqcore21:46:553
339950,0migration/312803-21kthreadcore19:56:553
339950,0migration/311166-21taskset22:58:343
329950,0watchdog/37572-21ntp_states21:21:573
329950,0watchdog/33306-21python21:57:013
329950,0watchdog/30-21swapper/322:41:573
329950,0watchdog/30-21swapper/321:34:373
29815050,0irq/29-eth0-tx-8744-21df_abs23:36:522
29815050,0irq/29-eth0-tx-4119-21munin-node22:56:502
29815050,0irq/29-eth0-tx-3002-21irqrtprio22:36:552
29815050,0irq/29-eth0-tx-29988-21munin-node00:26:552
29815050,0irq/29-eth0-tx-29302-21munin-node21:56:492
29815050,0irq/29-eth0-tx-26573-21cut22:31:542
29815050,0irq/29-eth0-tx-2056-21ssh22:52:362
29815050,0irq/29-eth0-tx-15778-21munin-node20:46:500
29815050,0irq/29-eth0-tx-11835-21munin-node19:36:510
29815050,0irq/29-eth0-tx-0-21swapper/222:13:412
29815050,0irq/29-eth0-tx-0-21swapper/221:52:052
29815050,0irq/29-eth0-tx-0-21swapper/200:43:102
29815050,0irq/29-eth0-tx-0-21swapper/200:33:332
29815050,0irq/29-eth0-tx-0-21swapper/200:26:122
29815050,0irq/29-eth0-tx-0-21swapper/020:36:560
29815050,0irq/29-eth0-tx-0-21swapper/020:31:550
29805050,0irq/28-eth0-rx-6314-21runrttasks21:27:213
29805050,0irq/28-eth0-rx-32457-21grep00:46:503
29805050,0irq/28-eth0-rx-30256-21sshd20:11:503
29805050,0irq/28-eth0-rx-29174-21grep20:07:033
29805050,0irq/28-eth0-rx-18963-21kthreadcore23:41:553
29805050,0irq/28-eth0-rx-11956-21aten_r1power_po19:36:483
29805050,0irq/28-eth0-rx-0-21swapper/323:56:473
29805050,0irq/28-eth0-rx-0-21swapper/323:46:543
29805050,0irq/28-eth0-rx-0-21swapper/323:36:533
29805050,0irq/28-eth0-rx-0-21swapper/323:31:553
29805050,0irq/28-eth0-rx-0-21swapper/323:11:403
29805050,0irq/28-eth0-rx-0-21swapper/323:06:513
29805050,0irq/28-eth0-rx-0-21swapper/322:38:423
29805050,0irq/28-eth0-rx-0-21swapper/322:21:553
29805050,0irq/28-eth0-rx-0-21swapper/322:14:333
29805050,0irq/28-eth0-rx-0-21swapper/300:55:563
29805050,0irq/28-eth0-rx-0-21swapper/300:26:003
29805050,0irq/28-eth0-rx-0-21swapper/300:17:473
29805050,0irq/28-eth0-rx-0-21swapper/300:03:583
295169955,0cyclictest0-21swapper/221:26:282
295159955,0cyclictest0-21swapper/122:20:031
295159950,0cyclictest0-21swapper/123:34:001
295159950,0cyclictest0-21swapper/122:34:151
295159950,0cyclictest0-21swapper/121:53:251
295159950,0cyclictest0-21swapper/100:09:281
295149955,0cyclictest0-21swapper/022:59:230
295149950,0cyclictest0-21swapper/022:20:260
259950,0migration/29987-21kthreadcore21:01:562
259950,0migration/27915-21kthreadcore21:41:572
259950,0migration/25788-21munin-node20:16:532
259950,0migration/224279-21taskset22:29:382
259950,0migration/217301-21kthreadcore23:01:572
259950,0migration/21276-21latency_hist21:21:372
259950,0migration/211436-21kthreadcore19:56:552
249950,0watchdog/211650-21memory22:01:572
179950,0migration/19547-21sh23:54:391
179950,0migration/17033-21fschecks_time00:31:511
179950,0migration/15880-21latency_hist23:16:381
179950,0migration/12896-21aten_r1power_fr21:41:491
179950,0migration/124155-21sh23:06:571
179950,0migration/122622-21sh23:25:211
179950,0migration/12205-21sh22:52:591
179950,0migration/120967-21kthreadcore23:41:551
179950,0migration/117810-21munin-node19:36:561
179950,0migration/112908-21fschecks_time21:06:511
179950,0migration/112471-21kthreadcore21:26:541
169950,0watchdog/117419-21cut22:06:571
149950,0migration/08908-21aten_r1power_po21:26:480
149950,0migration/08011-21kthreadcore00:31:550
149950,0migration/0705-21kthreadcore20:11:550
149950,0migration/05938-21kthreadcore22:36:560
149950,0migration/05438-21kthreadcore23:31:550
149950,0migration/04998-21latency_hist21:01:370
149950,0migration/03494-21proc_pri19:26:590
149950,0migration/029648-21kthreadcore22:51:550
149950,0migration/028826-21kthreadcore00:41:570
149950,0migration/025057-21kthreadcore20:51:550
149950,0migration/025040-21munin-node00:01:560
149950,0migration/023439-21kthreadcore22:46:550
149950,0migration/020620-21aten_r1power_en21:51:500
149950,0migration/016934-21kthreadcore00:36:560
149950,0migration/015038-21cpuspeed_turbos23:21:510
149950,0migration/012318-21sh21:06:490
149950,0migration/011931-21munin-node22:01:590
149950,0migration/011563-21taskset20:18:270
149950,0migration/011183-21kthreadcore23:36:570
8305040,0irq/26-0000:00:20112-21if_eth122:46:532
8305040,0irq/26-0000:00:0-21swapper/220:46:512
8305040,0irq/26-0000:00:0-21swapper/220:41:372
339940,0migration/37706-21kthreadcore20:16:563
339940,0migration/321519-21kthreadcore20:26:553
339940,0migration/319269-21cpuspeed_turbos22:46:503
329940,0watchdog/329585-21kthreadcore20:31:563
29815040,0irq/29-eth0-tx-4053-21munin-node00:11:512
29815040,0irq/29-eth0-tx-0-21swapper/223:51:482
29815040,0irq/29-eth0-tx-0-21swapper/223:41:462
29815040,0irq/29-eth0-tx-0-21swapper/223:12:092
29815040,0irq/29-eth0-tx-0-21swapper/222:41:502
29815040,0irq/29-eth0-tx-0-21swapper/221:37:142
29815040,0irq/29-eth0-tx-0-21swapper/200:52:042
29815040,0irq/29-eth0-tx-0-21swapper/200:16:452
29815040,0irq/29-eth0-tx-0-21swapper/200:04:352
29815040,0irq/29-eth0-tx-0-21swapper/021:16:510
29815040,0irq/29-eth0-tx-0-21swapper/020:41:490
29805040,0irq/28-eth0-rx-0-21swapper/323:02:073
29805040,0irq/28-eth0-rx-0-21swapper/320:46:483
295169943,0cyclictest834-21awk00:46:532
295169943,0cyclictest7213-21awk23:16:562
295169943,0cyclictest3571-21lldpd20:56:452
295169943,0cyclictest3524-21snmpd23:26:392
295169943,0cyclictest3250-21irqbalance21:12:442
295169943,0cyclictest3250-21irqbalance20:26:442
295169943,0cyclictest3250-21irqbalance20:06:442
295169943,0cyclictest27252-21awk19:46:512
295169943,0cyclictest2309-21awk20:36:512
295169943,0cyclictest22209-21awk23:06:542
295169943,0cyclictest15440-21awk22:06:542
295169943,0cyclictest12987-21awk19:36:522
295169943,0cyclictest12920-21awk21:46:542
295159944,0cyclictest0-21swapper/121:57:591
295159943,0cyclictest5849-21awk20:16:531
295159943,0cyclictest3524-21snmpd22:27:381
295159943,0cyclictest3524-21snmpd22:11:381
295159943,0cyclictest3524-21snmpd22:04:231
295159943,0cyclictest3524-21snmpd00:36:551
295159943,0cyclictest31260-21awk20:56:541
295159943,0cyclictest27802-21awk21:16:531
295159943,0cyclictest27368-21awk21:36:511
295159943,0cyclictest2339-21awk20:36:511
295159943,0cyclictest2154-21awk19:51:541
295159943,0cyclictest2154-21awk19:51:541
295149944,0cyclictest0-21swapper/020:02:580
295149943,0cyclictest5660-21awk19:31:530
295149943,0cyclictest3940-21awk21:41:540
295149943,0cyclictest3571-21lldpd00:30:170
295149943,0cyclictest3524-21snmpd23:50:540
295149943,0cyclictest3524-21snmpd23:41:390
295149943,0cyclictest3524-21snmpd21:39:230
295149943,0cyclictest3524-21snmpd20:00:210
295149943,0cyclictest31284-21awk20:56:540
295149943,0cyclictest26392-21awk22:31:520
295149943,0cyclictest24051-21awk22:11:530
295149943,0cyclictest20357-21awk20:26:530
295149943,0cyclictest20110-21awk19:41:530
295149943,0cyclictest11445-21awk22:41:540
259940,0migration/24875-21kthreadcore23:31:552
259940,0migration/224922-21kthreadcore20:51:552
259940,0migration/220392-21kthreadcore00:36:572
259940,0migration/216755-21proc_pri23:56:582
259940,0migration/216343-21fschecks_time20:01:512
259940,0migration/215613-21fschecks_time23:21:522
259940,0migration/212805-21kthreadcore22:21:552
259940,0migration/21113-21aten_r1power_po19:51:502
259940,0migration/21113-21aten_r1power_po19:51:502
259940,0migration/210613-21kthreadcore21:26:542
249940,0watchdog/231991-21grep22:16:492
249940,0watchdog/229584-21kthreadcore20:31:562
249940,0watchdog/22746-21ssh00:08:572
249940,0watchdog/20-21swapper/221:31:572
249940,0watchdog/20-21swapper/220:11:522
249940,0watchdog/20-21swapper/219:26:522
179940,0migration/19787-21diskmemload00:51:541
179940,0migration/18525-21cpuspeed_turbos19:56:501
179940,0migration/18320-21kthreadcore23:16:571
179940,0migration/13684-21switchtime19:27:021
179940,0migration/132742-21switchtime20:32:041
179940,0migration/132339-21aten_r1power_vo00:46:501
179940,0migration/130947-21idleruntime20:11:521
179940,0migration/129821-21latency_hist20:11:381
179940,0migration/125063-21latency20:26:561
179940,0migration/124240-21fschecks_time00:41:531
179940,0migration/123940-21fschecks_count23:26:511
179940,0migration/119353-21cpuspeed_turbos19:41:501
179940,0migration/118752-21proc_pri23:02:001
179940,0migration/116108-21fschecks_count20:01:511
179940,0migration/114918-21taskset22:22:361
179940,0migration/111902-21taskset21:05:201
179940,0migration/110539-21unixbench_multi22:57:031
169940,0watchdog/16314-21runrttasks20:47:241
169940,0watchdog/130697-21grep00:26:531
169940,0watchdog/127260-21cat00:22:011
169940,0watchdog/126746-21ssh00:04:411
169940,0watchdog/117024-21ssh22:42:051
169940,0watchdog/111832-21kthreadcore23:36:571
169940,0watchdog/111760-21interrupts23:56:531
169940,0watchdog/110978-21ssh00:12:331
169940,0watchdog/10-21swapper/122:39:131
169940,0watchdog/10-21swapper/121:46:571
149940,0migration/0715-21turbostat19:56:330
149940,0migration/0715-21turbostat19:56:330
149940,0migration/016403-21kthreadcore00:16:550
149940,0migration/010780-21cpuspeed_turbos23:56:490
329930,0watchdog/30-21swapper/321:11:493
329930,0watchdog/30-21swapper/320:41:483
329930,0watchdog/30-21swapper/319:55:563
329930,0watchdog/30-21swapper/319:55:563
29805030,0irq/28-eth0-rx-0-21swapper/320:39:063
295169932,0cyclictest3524-21snmpd19:32:062
295169932,0cyclictest20882-21kthreadcore19:41:552
295169932,0cyclictest13462-21tail21:06:542
295159933,0cyclictest0-21swapper/119:32:091
295159932,0cyclictest7785-21sensors21:21:591
295159930,0cyclictest23806-21perl20:51:511
295149933,0cyclictest13229-21kworker/0:000:21:590
295149932,0cyclictest8549-21diskmemload23:02:420
295149932,0cyclictest6484-21ssh23:16:530
295149932,0cyclictest31726-21munin-run23:31:380
295149932,0cyclictest30412-21awk21:56:530
295149932,0cyclictest3032-21awk23:51:550
295149932,0cyclictest21314-21kthreadcore21:11:550
295149932,0cyclictest18467-21awk21:31:540
295149930,0cyclictest8562-21munin-node00:52:000
295149930,0cyclictest8549-21diskmemload22:26:100
295149930,0cyclictest8520-40yum-updatesd-he21:26:270
295149930,0cyclictest4810-21tune2fs00:11:520
295149930,0cyclictest12074-21munin-node20:21:550
249930,0watchdog/20-21swapper/220:21:482
179930,0migration/128976-21kthreadcore19:46:541
169930,0watchdog/10-21swapper/122:49:251
169930,0watchdog/10-21swapper/121:11:491
169930,0watchdog/10-21swapper/100:20:371
329920,0watchdog/30-21swapper/319:46:403
29805020,0irq/28-eth0-rx-0-21swapper/321:16:393
295159921,0cyclictest0-21swapper/120:21:381
295159920,0cyclictest0-21swapper/120:41:371
295149921,0cyclictest26801-21grep19:46:500
295149921,0cyclictest0-21swapper/020:06:490
295149920,0cyclictest11632-21latency_hist21:46:370
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional