You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 00:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Sun May 24, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2779624637,0sleep20-21swapper/207:21:372
2790124535,0sleep10-21swapper/107:22:481
2772123826,0sleep30-21swapper/307:20:463
2790723624,0sleep00-21swapper/007:22:510
280349976,0cyclictest0-21swapper/110:48:431
29805060,0irq/28-eth0-rx-730-21cut12:43:473
29805060,0irq/28-eth0-rx-31347-21perl11:28:443
29805060,0irq/28-eth0-rx-23236-21taskset11:41:393
29805060,0irq/28-eth0-rx-22847-21df12:38:443
29805060,0irq/28-eth0-rx-17119-21open_files10:58:513
280359960,0cyclictest0-21swapper/210:19:592
149960,0migration/06058-21gltestperf12:28:440
149960,0migration/022648-21sh11:40:010
149960,0migration/020572-21taskset11:20:340
149960,0migration/014939-21sh09:26:440
149960,0migration/01075-21sh10:51:030
4150,0ktimersoftd/00-21swapper/010:45:330
339950,0migration/36678-21kthreadcore09:38:483
339950,0migration/36638-21kthreadcore09:58:463
339950,0migration/36327-21unixbench_singl08:33:553
339950,0migration/35446-21kthreadcore11:48:473
339950,0migration/332078-21kthreadcore11:08:473
339950,0migration/331981-21kthreadcore10:13:463
339950,0migration/331570-21kthreadcore12:23:473
339950,0migration/328552-21kthreadcore07:43:463
339950,0migration/326368-21diskmemload11:04:063
339950,0migration/324464-21fschecks_time10:28:423
339950,0migration/324117-21munin-node09:08:533
339950,0migration/324058-21runrttasks11:43:303
339950,0migration/322329-21kthreadcore07:38:473
339950,0migration/322084-21aten_r1power_vo11:23:413
339950,0migration/321521-21kthreadcore10:43:473
339950,0migration/320680-21kthreadcore11:58:483
339950,0migration/31886-21kthreadcore10:33:473
339950,0migration/315189-21aten_r1power_po10:23:403
339950,0migration/313229-21runrttasks11:18:323
339950,0migration/313221-21kthreadcore10:38:483
339950,0migration/312597-21kthreadcore07:33:463
329950,0watchdog/39531-21python08:13:523
329950,0watchdog/329672-21if_err_eth1.308:53:443
329950,0watchdog/325576-21fschecks_count09:13:443
29815050,0irq/29-eth0-tx-7365-21ssh10:35:382
29815050,0irq/29-eth0-tx-21129-21tr09:28:482
29815050,0irq/29-eth0-tx-2075-21kthreadcore11:28:482
29815050,0irq/29-eth0-tx-0-21swapper/212:43:452
29815050,0irq/29-eth0-tx-0-21swapper/209:25:372
29815050,0irq/29-eth0-tx-0-21swapper/008:28:510
29815050,0irq/29-eth0-tx-0-21swapper/008:13:510
29805050,0irq/28-eth0-rx-8114-21cut10:53:483
29805050,0irq/28-eth0-rx-5772sleep310:49:483
29805050,0irq/28-eth0-rx-26914-21ssh09:51:433
29805050,0irq/28-eth0-rx-23986-21expr08:23:543
29805050,0irq/28-eth0-rx-18033-21cut09:28:473
29805050,0irq/28-eth0-rx-14847-21ssh11:37:193
29805050,0irq/28-eth0-rx-14329-21grep12:33:433
29805050,0irq/28-eth0-rx-12006-21sshd11:15:453
29805050,0irq/28-eth0-rx-1141-21grep08:08:483
29805050,0irq/28-eth0-rx-0-21swapper/312:31:403
29805050,0irq/28-eth0-rx-0-21swapper/312:13:413
29805050,0irq/28-eth0-rx-0-21swapper/312:10:433
29805050,0irq/28-eth0-rx-0-21swapper/312:03:353
29805050,0irq/28-eth0-rx-0-21swapper/309:57:363
29805050,0irq/28-eth0-rx-0-21swapper/309:28:203
29805050,0irq/28-eth0-rx-0-21swapper/308:03:473
280359955,0cyclictest0-21swapper/212:16:292
280359955,0cyclictest0-21swapper/210:38:452
280359955,0cyclictest0-21swapper/210:02:482
280359954,0cyclictest3524-21snmpd07:44:582
280359954,0cyclictest32067-21crond10:33:292
280359950,0cyclictest0-21swapper/212:40:372
280359950,0cyclictest0-21swapper/209:53:012
280349955,0cyclictest0-21swapper/112:28:311
280349950,0cyclictest6991-21diskmemload10:02:511
280339955,0cyclictest0-21swapper/009:28:460
280339950,0cyclictest0-21swapper/011:32:130
280339950,0cyclictest0-21swapper/010:01:530
27150,0ktimersoftd/20-21swapper/208:28:592
259950,0migration/223887-21timerwakeupswit10:43:552
259950,0migration/217742-21kthreadcore12:33:482
259950,0migration/211003-21taskset12:12:542
249950,0watchdog/29336-21ssh11:53:412
179950,0migration/18981-21latency_hist11:53:301
179950,0migration/18588-21idleruntime12:48:441
179950,0migration/18504-21kthreadcore07:28:461
179950,0migration/17467-21fschecks_count08:38:441
179950,0migration/16029-21munin-node10:33:491
179950,0migration/129651-21munin-node07:23:501
179950,0migration/12801-21kthreadcore07:48:471
179950,0migration/127353-21latency10:08:491
179950,0migration/124296-21sh10:44:351
179950,0migration/11501-21aten_r1power_vo09:38:421
179950,0migration/111050-21switchtime11:13:571
149950,0migration/08560-21kthreadcore08:58:470
149950,0migration/08560-21kthreadcore08:58:470
149950,0migration/08189-21sh10:37:530
149950,0migration/07817-21munin-node07:53:440
149950,0migration/07364-21kthreadcore07:28:460
149950,0migration/06473-21taskset12:46:200
149950,0migration/05311-21kthreadcore12:08:490
149950,0migration/05221-21taskset10:15:550
149950,0migration/05183-21kthreadcore10:53:470
149950,0migration/032189-21kthreadcore08:08:480
149950,0migration/031755-21sh11:46:130
149950,0migration/030000-21kthreadcore09:33:480
149950,0migration/029648-21kthreadcore09:53:460
149950,0migration/029278-21idleruntime11:08:440
149950,0migration/028909-21cpuspeed_turbos08:53:410
149950,0migration/028677-21sh10:10:160
149950,0migration/028432-21kthreadcore12:38:500
149950,0migration/028148-21taskset12:22:290
149950,0migration/027346-21processes08:03:520
149950,0migration/024905-21latency_hist09:13:300
149950,0migration/022125-21kthreadcore11:03:470
149950,0migration/021842-21latency_hist11:23:300
149950,0migration/021111-21kthreadcore07:38:470
149950,0migration/020207-21kthreadcore10:23:470
149950,0migration/019908-21missed_timers07:58:480
149950,0migration/019729-21latency12:33:480
149950,0migration/01597-21cpuspeed_turbos09:38:420
149950,0migration/014741-21munin-node08:43:410
149950,0migration/013567-21taskset08:38:570
149950,0migration/013254-21kthreadcore12:13:470
149950,0migration/012834-21sh10:03:400
149950,0migration/012807-21kthreadcore11:53:470
149950,0migration/010942-21fschecks_count07:33:420
149950,0migration/010045-21kthreadcore11:33:470
339940,0migration/34735-21kthreadcore09:18:473
339940,0migration/328274-21kthreadcore09:33:473
339940,0migration/327887-21kthreadcore08:28:473
339940,0migration/314523-21df08:43:403
339940,0migration/311298-21fschecks_count09:03:433
339940,0migration/310928-21kthreadcore12:48:473
339940,0migration/310191-21latency_hist09:43:293
329940,0watchdog/310303-21kthreadcore08:38:483
329940,0watchdog/30-21swapper/311:53:413
329940,0watchdog/30-21swapper/310:18:403
329940,0watchdog/30-21swapper/307:53:443
29815040,0irq/29-eth0-tx-9371-21ssh10:54:492
29815040,0irq/29-eth0-tx-4781-21telnet11:13:442
29815040,0irq/29-eth0-tx-26723-21sed12:18:552
29815040,0irq/29-eth0-tx-26493-21ssh12:03:382
29815040,0irq/29-eth0-tx-13943-21ssh11:34:502
29815040,0irq/29-eth0-tx-0-21swapper/211:48:402
29815040,0irq/29-eth0-tx-0-21swapper/211:43:332
29815040,0irq/29-eth0-tx-0-21swapper/211:23:422
29815040,0irq/29-eth0-tx-0-21swapper/210:58:342
29815040,0irq/29-eth0-tx-0-21swapper/210:48:312
29815040,0irq/29-eth0-tx-0-21swapper/210:23:322
29815040,0irq/29-eth0-tx-0-21swapper/209:53:312
29815040,0irq/29-eth0-tx-0-21swapper/209:44:082
29815040,0irq/29-eth0-tx-0-21swapper/209:33:582
29815040,0irq/29-eth0-tx-0-21swapper/008:33:460
29815040,0irq/29-eth0-tx-0-21swapper/007:45:280
29805040,0irq/28-eth0-rx-13030-21cpuspeed_turbos10:03:413
29805040,0irq/28-eth0-rx-0-21swapper/312:18:363
29805040,0irq/28-eth0-rx-0-21swapper/310:08:463
29805040,0irq/28-eth0-rx-0-21swapper/308:58:493
29805040,0irq/28-eth0-rx-0-21swapper/308:58:493
29805040,0irq/28-eth0-rx-0-21swapper/307:48:473
280359944,0cyclictest0-21swapper/211:08:512
280359943,0cyclictest4507-21awk08:58:442
280359943,0cyclictest4507-21awk08:58:442
280359943,0cyclictest3571-21lldpd11:38:352
280359943,0cyclictest3571-21lldpd10:03:342
280359943,0cyclictest3571-21lldpd09:14:342
280359943,0cyclictest3571-21lldpd09:03:342
280359943,0cyclictest3571-21lldpd08:40:042
280359943,0cyclictest3571-21lldpd08:18:342
280359943,0cyclictest3571-21lldpd08:01:042
280359943,0cyclictest3571-21lldpd07:24:032
280359943,0cyclictest3250-21irqbalance11:18:462
280359943,0cyclictest3250-21irqbalance09:38:562
280359943,0cyclictest3250-21irqbalance09:09:062
280359943,0cyclictest3250-21irqbalance07:38:452
280359943,0cyclictest3250-21irqbalance07:34:152
280359943,0cyclictest22483-21awk08:48:452
280349944,0cyclictest0-21swapper/110:13:431
280349943,0cyclictest9877-21awk10:38:451
280349943,0cyclictest3571-21lldpd11:18:341
280349943,0cyclictest3571-21lldpd08:17:041
280349943,0cyclictest3524-21snmpd10:03:441
280349943,0cyclictest29355-21awk11:08:451
280349943,0cyclictest16620-21awk11:38:451
280349943,0cyclictest11837-21awk09:03:451
280349940,0cyclictest0-21swapper/110:54:141
280339943,0cyclictest3524-21snmpd09:20:590
280339941,0cyclictest0-21swapper/007:23:450
280339940,0cyclictest21403-21munin-node08:48:430
259940,0migration/28571-21kthreadcore12:28:472
259940,0migration/27476-21latency_hist12:48:302
259940,0migration/23324-21cpuspeed_turbos07:28:402
259940,0migration/230882-21kthreadcore08:08:472
259940,0migration/230138-21aten_r1power_cu10:13:402
259940,0migration/228878-21aten_r1power_fr12:23:412
259940,0migration/226939-21kthreadcore10:08:492
259940,0migration/223461-21kthreadcore11:03:472
259940,0migration/220546-21kthreadcore11:58:482
249940,0watchdog/2936-21awk09:18:442
249940,0watchdog/27842-21idleruntime07:53:442
249940,0watchdog/221946-21perl08:03:442
249940,0watchdog/20-21swapper/208:53:442
249940,0watchdog/20-21swapper/208:43:522
179940,0migration/16625-21kthreadcore08:58:471
179940,0migration/16625-21kthreadcore08:58:471
179940,0migration/13698-21kthreadcore11:28:481
179940,0migration/131509-21kthreadcore08:08:481
179940,0migration/127371-21kthreadcore11:43:481
179940,0migration/125746-21kthreadcore10:28:461
179940,0migration/125659-21kthreadcore08:48:471
179940,0migration/123198-21kthreadcore12:18:481
179940,0migration/122693-21kthreadcore07:38:471
179940,0migration/121867-21kthreadcore11:58:481
179940,0migration/121187-21idleruntime-cro08:48:291
179940,0migration/117475-21timerandwakeup10:58:561
179940,0migration/116866-21gltestperf09:28:431
179940,0migration/115499-21kthreadcore12:33:471
179940,0migration/113658-21runrttasks07:56:361
169940,0watchdog/16542-21cut10:18:401
169940,0watchdog/128951-21switchtime12:38:571
169940,0watchdog/126505-21ssh11:04:291
169940,0watchdog/125577-21fschecks_count09:13:441
169940,0watchdog/12514-21ssh09:55:001
169940,0watchdog/124114-21kthreadcore08:03:481
169940,0watchdog/117372-40yum-updatesd-he08:21:481
169940,0watchdog/116660-21ssh11:56:011
169940,0watchdog/10-21swapper/112:43:571
169940,0watchdog/10-21swapper/112:08:491
169940,0watchdog/10-21swapper/109:35:521
169940,0watchdog/10-21swapper/109:08:481
169940,0watchdog/10-21swapper/108:28:481
149940,0migration/028052-21kthreadcore10:28:460
149940,0migration/025089-21latency_hist09:13:300
149940,0migration/022237-21kthreadcore09:48:470
149940,0migration/015300-21kthreadcore10:58:480
149940,0migration/012675-21kthreadcore12:48:470
149940,0migration/010401-21kthreadcore10:18:470
339930,0migration/312679-21kthreadcore08:18:473
329930,0watchdog/30-21swapper/307:58:563
29805030,0irq/28-eth0-rx-0-21swapper/308:48:463
29805030,0irq/28-eth0-rx-0-21swapper/307:29:563
29805030,0irq/28-eth0-rx-0-21swapper/307:23:453
280359933,0cyclictest4421-21awk08:13:452
280359933,0cyclictest3571-21lldpd08:24:042
280359933,0cyclictest3571-21lldpd07:48:332
280349933,0cyclictest29887-21awk12:23:451
280349932,0cyclictest875-21awk08:33:451
280349932,0cyclictest8369-21awk09:23:451
280349932,0cyclictest3524-21snmpd11:23:451
280349932,0cyclictest3524-21snmpd07:59:131
280349932,0cyclictest28568-21cat08:53:301
280349932,0cyclictest11587-21cut07:33:451
280349931,0cyclictest16252-21if_eth1.310:23:451
280349930,0cyclictest7763-21perl11:33:441
280339933,0cyclictest0-21swapper/009:44:230
280339932,0cyclictest6192-21cut11:48:470
280339932,0cyclictest5695-21awk11:13:470
280339932,0cyclictest3524-21snmpd12:01:170
280339932,0cyclictest29872-21awk12:23:450
280339932,0cyclictest20580-21tr08:23:470
280339932,0cyclictest10541-21munin-node08:18:480
280339930,0cyclictest0-21swapper/009:03:510
259930,0migration/232090-21latency_hist08:33:292
19130,0ktimersoftd/126476-21sh12:03:351
169930,0watchdog/16991-21diskmemload09:48:201
169930,0watchdog/10-21swapper/112:13:451
169930,0watchdog/10-21swapper/109:48:481
169930,0watchdog/10-21swapper/109:18:441
169930,0watchdog/10-21swapper/107:43:401
149930,0migration/016559-21runrttasks10:42:070
4120,0ktimersoftd/00-21swapper/012:03:350
280349920,0cyclictest17737-21latency_hist08:23:291
280339921,0cyclictest0-21swapper/007:48:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional