You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 02:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Thu Mar 26, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2263024233,0sleep20-21swapper/219:14:532
2289024129,0sleep10-21swapper/119:17:561
2262623728,0sleep30-21swapper/319:14:503
2270723329,0sleep00-21swapper/019:15:470
8305070,0irq/26-0000:00:3207-17auditd19:28:343
35160,0ktimersoftd/30-21swapper/321:08:543
339960,0migration/38504-21sh00:44:143
339960,0migration/34602-21taskset00:05:393
339960,0migration/330426-21munin-node22:48:553
339960,0migration/317419-21fschecks_time00:33:493
339960,0migration/312760-21sh00:09:163
339960,0migration/312535-21sh21:40:363
339960,0migration/310696-21sh22:35:563
29815060,0irq/29-eth0-tx-1698-21munin-node19:48:550
29815060,0irq/29-eth0-tx-16213-21munin-node19:58:520
29805060,0irq/28-eth0-rx-3016-21perl21:18:473
230249960,0cyclictest0-21swapper/222:14:002
230249960,0cyclictest0-21swapper/221:51:372
230219966,0cyclictest31448-21sensors23:23:561
179960,0migration/111959-21unixbench-2d20:13:591
149960,0migration/032320-21sh23:25:200
149960,0migration/027627-21sh22:44:550
149960,0migration/02047-21kthreadcore21:53:510
149960,0migration/012322-21kthreadcore22:18:520
149960,0migration/012322-21kthreadcore22:18:520
339950,0migration/36747-21kthreadcore22:13:523
339950,0migration/34163-21kthreadcore20:33:523
339950,0migration/332710-21taskset22:12:303
339950,0migration/329614-21switchtime00:19:003
339950,0migration/326417-21munin-node00:38:513
339950,0migration/324793-21kthreadcore19:38:523
339950,0migration/323669-21kthreadcore23:38:533
339950,0migration/321583-21kthreadcore20:43:523
339950,0migration/320977-21taskset23:58:433
339950,0migration/31770-21taskset23:44:163
339950,0migration/317140-21kthreadcore21:03:533
339950,0migration/316952-21sh23:34:153
339950,0migration/315572-21munin-node20:39:003
329950,0watchdog/3706-21grep22:28:543
329950,0watchdog/36314-21runrttasks22:56:583
329950,0watchdog/332381-21kthreadcore20:53:493
329950,0watchdog/320085-21cpuspeed_turbos21:28:463
29815050,0irq/29-eth0-tx-1596-21munin-node00:43:562
29815050,0irq/29-eth0-tx-1556-40yum-updatesd-he21:14:300
29815050,0irq/29-eth0-tx-0-21swapper/221:44:162
29815050,0irq/29-eth0-tx-0-21swapper/021:08:540
29815050,0irq/29-eth0-tx-0-21swapper/019:47:240
29815050,0irq/29-eth0-tx-0-21swapper/019:38:500
29805050,0irq/28-eth0-rx-4717-21kthreadcore00:23:543
29805050,0irq/28-eth0-rx-28823-21kthreadcore23:23:523
29805050,0irq/28-eth0-rx-22661-21awk19:58:593
29805050,0irq/28-eth0-rx-19581-21iostat22:23:513
29805050,0irq/28-eth0-rx-18552-21port_sshpriv23:53:563
29805050,0irq/28-eth0-rx-18031-21ssh21:24:523
29805050,0irq/28-eth0-rx-14753-21cut22:58:483
29805050,0irq/28-eth0-rx-11868-21kthreadcore19:53:503
29805050,0irq/28-eth0-rx-0-21swapper/323:48:523
29805050,0irq/28-eth0-rx-0-21swapper/323:18:473
29805050,0irq/28-eth0-rx-0-21swapper/323:08:513
29805050,0irq/28-eth0-rx-0-21swapper/323:03:473
29805050,0irq/28-eth0-rx-0-21swapper/322:43:533
29805050,0irq/28-eth0-rx-0-21swapper/321:53:523
29805050,0irq/28-eth0-rx-0-21swapper/321:48:533
29805050,0irq/28-eth0-rx-0-21swapper/300:17:523
249950,0watchdog/2983-21switchtime22:28:582
230249955,0cyclictest0-21swapper/223:14:042
230249955,0cyclictest0-21swapper/222:05:202
230249955,0cyclictest0-21swapper/200:17:462
230249950,0cyclictest0-21swapper/223:34:432
230249950,0cyclictest0-21swapper/222:49:472
230249950,0cyclictest0-21swapper/221:41:122
230249950,0cyclictest0-21swapper/221:26:522
230219955,0cyclictest0-21swapper/123:09:461
230219955,0cyclictest0-21swapper/121:24:361
230219954,0cyclictest19791-21ps22:23:511
230219950,0cyclictest0-21swapper/122:47:221
230219950,0cyclictest0-21swapper/122:13:291
230219950,0cyclictest0-21swapper/121:35:001
230219950,0cyclictest0-21swapper/100:44:311
230209955,0cyclictest0-21swapper/023:46:260
230209950,0cyclictest0-21swapper/000:22:230
230209950,0cyclictest0-21swapper/000:12:080
179950,0migration/19474-21kthreadcore00:08:521
179950,0migration/17347-21kthreadcore20:33:531
179950,0migration/1479-21munin-node20:28:531
179950,0migration/127228-21latency_hist23:43:351
179950,0migration/124301-21munin-node00:18:511
179950,0migration/123570-21fschecks_time23:03:471
179950,0migration/119656-21kthreadcore20:43:511
179950,0migration/119344-21taskset20:19:301
179950,0migration/115276-21sh00:30:221
179950,0migration/115010-21kthreadcore21:03:521
179950,0migration/110027-21cpuspeed_turbos22:18:471
179950,0migration/110027-21cpuspeed_turbos22:18:471
149950,0migration/09046-21sh21:19:140
149950,0migration/07503-21switchtime22:13:590
149950,0migration/07044-21kthreadcore23:28:520
149950,0migration/06110-21taskset19:28:480
149950,0migration/05254-21turbostat20:13:340
149950,0migration/04646-21sendmail_mailst20:53:540
149950,0migration/04250-21taskset22:50:480
149950,0migration/03520-21kthreadcore19:23:530
149950,0migration/03105-21latency_hist22:33:350
149950,0migration/029738-21kthreadcore00:38:540
149950,0migration/029029-21cpuspeed_turbos21:33:480
149950,0migration/027113-21latency_hist20:28:340
149950,0migration/024915-21kthreadcore21:28:510
149950,0migration/024274-21fschecks_time20:48:470
149950,0migration/023903-21fschecks_count20:03:480
149950,0migration/022057-21kthreadcore22:23:520
149950,0migration/021730-21kthreadcore22:03:540
149950,0migration/02039-21kthreadcore23:08:520
149950,0migration/020204-21missed_timers22:58:530
149950,0migration/019959-21kthreadcore23:18:520
149950,0migration/016159-21sh00:13:510
149950,0migration/014709-21kthreadcore23:33:530
149950,0migration/014227-21kthreadcore19:33:500
149950,0migration/011927-21munin-node20:58:560
149950,0migration/011693-21timerwakeupswit21:38:590
149950,0migration/011332-21kthreadcore00:28:540
339940,0migration/323959-21fschecks_time19:18:483
339940,0migration/320910-21taskset21:44:433
339940,0migration/319419-21runrttasks19:37:463
339940,0migration/312561-21taskset21:02:103
329940,0watchdog/312502-21crond20:23:293
329940,0watchdog/30-21swapper/322:18:503
329940,0watchdog/30-21swapper/322:18:503
329940,0watchdog/30-21swapper/319:43:533
29815040,0irq/29-eth0-tx-7623-21ssh21:58:452
29815040,0irq/29-eth0-tx-31775-21ssh00:23:382
29815040,0irq/29-eth0-tx-31551-21ssh21:53:462
29815040,0irq/29-eth0-tx-25090-21ssh23:23:422
29815040,0irq/29-eth0-tx-19396-21ssh22:41:022
29815040,0irq/29-eth0-tx-14179-21ssh22:58:412
29815040,0irq/29-eth0-tx-0-21swapper/223:58:372
29815040,0irq/29-eth0-tx-0-21swapper/222:33:572
29815040,0irq/29-eth0-tx-0-21swapper/222:24:092
29815040,0irq/29-eth0-tx-0-21swapper/222:18:432
29815040,0irq/29-eth0-tx-0-21swapper/222:18:432
29815040,0irq/29-eth0-tx-0-21swapper/222:10:222
29815040,0irq/29-eth0-tx-0-21swapper/200:39:262
29815040,0irq/29-eth0-tx-0-21swapper/200:03:432
29815040,0irq/29-eth0-tx-0-21swapper/020:38:550
29815040,0irq/29-eth0-tx-0-21swapper/019:22:180
29805040,0irq/28-eth0-rx-7801-21sh23:13:393
29805040,0irq/28-eth0-rx-7072-21kthreadcore20:13:513
29805040,0irq/28-eth0-rx-17756-21kthreadcore22:03:533
29805040,0irq/28-eth0-rx-0-21swapper/323:28:393
29805040,0irq/28-eth0-rx-0-21swapper/322:38:473
29805040,0irq/28-eth0-rx-0-21swapper/321:58:403
29805040,0irq/28-eth0-rx-0-21swapper/321:34:043
29805040,0irq/28-eth0-rx-0-21swapper/320:08:553
29805040,0irq/28-eth0-rx-0-21swapper/320:03:523
29805040,0irq/28-eth0-rx-0-21swapper/300:28:423
259940,0migration/231492-21kthreadcore21:33:532
259940,0migration/22951-21kthreadcore20:08:532
259940,0migration/228872-21kthreadcore19:43:522
259940,0migration/227284-21latency_hist21:13:352
259940,0migration/223270-21df_inode23:03:472
259940,0migration/221158-21kthreadcore23:18:532
259940,0migration/219016-21kthreadcore20:43:512
259940,0migration/218460-21kthreadcore00:33:522
259940,0migration/217694-21irqrtprio19:58:502
259940,0migration/215983-21kthreadcore19:33:512
259940,0migration/213715-21irqcore23:53:522
259940,0migration/210286-21timerwakeupswit23:49:002
249940,0watchdog/231445-21ssh23:08:382
249940,0watchdog/227307-21yum22:44:022
249940,0watchdog/220088-21cpuspeed_turbos21:28:462
230249943,0cyclictest8986-21sadc20:38:342
230249943,0cyclictest7080-21awk00:08:502
230249943,0cyclictest6656-21awk22:53:512
230249943,0cyclictest5435-21sadc20:58:352
230249943,0cyclictest3571-21lldpd21:19:082
230249943,0cyclictest3524-21snmpd21:13:042
230249943,0cyclictest3524-21snmpd20:30:342
230249943,0cyclictest3524-21snmpd20:27:342
230249943,0cyclictest3524-21snmpd19:54:042
230249943,0cyclictest3524-21snmpd19:25:332
230249943,0cyclictest3250-21irqbalance00:28:522
230249943,0cyclictest3250-21irqbalance00:18:512
230249943,0cyclictest24682-21awk20:48:492
230249943,0cyclictest2460-21awk23:28:502
230249943,0cyclictest24336-21awk19:18:502
230249943,0cyclictest18793-21munin-node23:38:512
230249943,0cyclictest14049-21awk21:03:512
230249943,0cyclictest13889-21awk20:18:502
230249943,0cyclictest10324-21awk20:38:512
230249940,0cyclictest27401-21munin-node23:43:532
230249940,0cyclictest0-21swapper/220:14:292
230219944,0cyclictest0-21swapper/122:39:201
230219943,0cyclictest465-21awk00:23:511
230219943,0cyclictest3571-21lldpd20:53:081
230219943,0cyclictest3524-21snmpd21:53:501
230219943,0cyclictest21038-21awk20:23:511
230219943,0cyclictest17805-21awk00:33:511
230219943,0cyclictest10191-21awk19:53:491
230209944,0cyclictest0-21swapper/022:55:400
230209944,0cyclictest0-21swapper/021:25:580
230209943,0cyclictest6576-21awk20:13:500
230209943,0cyclictest4770-21awk23:48:500
230209943,0cyclictest3571-21lldpd21:58:380
230209943,0cyclictest3524-21snmpd00:26:060
230209943,0cyclictest19842-21awk23:38:500
230209943,0cyclictest16231-21sadc23:18:340
230209943,0cyclictest10050-21awk19:53:480
19140,0ktimersoftd/10-21swapper/120:58:451
179940,0migration/19501-21kthreadcore23:48:531
179940,0migration/1849-21latency_hist22:13:351
179940,0migration/18434-21runrttasks19:49:371
179940,0migration/17617-21munin-node23:28:551
179940,0migration/129751-21fschecks_count22:48:521
179940,0migration/127477-21kthreadcore20:03:531
179940,0migration/124376-21kthreadcore23:58:521
179940,0migration/123559-21df19:18:471
179940,0migration/122395-21munin-node19:58:551
179940,0migration/118185-21kthreadcore19:33:511
179940,0migration/118104-21kthreadcore23:18:521
179940,0migration/116297-21aten_r1power_vo22:03:471
179940,0migration/116266-21kthreadcore00:13:521
179940,0migration/113964-21aten_r1power_cu21:43:461
179940,0migration/111298-21kthreadcore22:53:541
179940,0migration/110662-21fschecks_count23:33:481
169940,0watchdog/13313-21sh23:48:301
169940,0watchdog/132448-21kthreadcore20:53:491
169940,0watchdog/130410-21kthreadcore19:43:531
169940,0watchdog/130236-21cut00:38:541
169940,0watchdog/120087-21cpuspeed_turbos21:28:461
169940,0watchdog/11589-21ssh22:29:501
169940,0watchdog/112917-21ssh21:41:341
149940,0migration/027470-21kthreadcore21:48:520
149940,0migration/026070-21kthreadcore23:03:510
149940,0migration/020354-21df_inode20:23:480
149940,0migration/018794-21sh22:39:220
149940,0migration/018002-21kthreadcore20:43:510
149940,0migration/017229-21kthreadcore23:53:530
329930,0watchdog/30-21swapper/321:13:493
329930,0watchdog/30-21swapper/320:23:533
329930,0watchdog/30-21swapper/319:48:573
329930,0watchdog/30-21swapper/319:28:573
29805030,0irq/28-eth0-rx-0-21swapper/320:48:593
29805030,0irq/28-eth0-rx-0-21swapper/320:28:463
249930,0watchdog/20-21swapper/220:03:532
249930,0watchdog/20-21swapper/219:48:572
230249932,0cyclictest6359-21awk19:28:502
230249930,0cyclictest6577-21perl20:58:482
230249930,0cyclictest0-21swapper/219:39:582
230219933,0cyclictest3571-21lldpd19:28:361
230219932,0cyclictest8773-21head23:13:501
230219932,0cyclictest3851-21kthreadcore21:18:511
230219932,0cyclictest3641-21smartctl00:03:571
230219932,0cyclictest28445-21if_eth121:13:491
230219932,0cyclictest21361-21cut21:08:501
230219932,0cyclictest13434-21awk23:53:501
230219932,0cyclictest10348-21awk20:38:511
230219930,0cyclictest26922-21cut21:48:521
230209933,0cyclictest22059-21awk23:58:500
230209933,0cyclictest0-21swapper/022:08:410
230209932,0cyclictest3571-21lldpd00:44:110
230209932,0cyclictest3524-21snmpd00:04:060
230209932,0cyclictest23042-21sensors00:33:570
230209932,0cyclictest15025-21awk21:43:500
230209931,0cyclictest18541-21kthreadcore21:03:530
230209930,0cyclictest4115-21perl22:33:470
230209930,0cyclictest15354-21cut20:18:520
169930,0watchdog/16314-21runrttasks19:40:131
169930,0watchdog/10-21swapper/122:58:461
169930,0watchdog/10-21swapper/122:33:461
169930,0watchdog/10-21swapper/121:58:581
169930,0watchdog/10-21swapper/119:23:571
230219921,0cyclictest0-21swapper/120:08:341
230209921,0cyclictest0-21swapper/020:33:470
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional