You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 18:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Mon Mar 23, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
440525444,0sleep30-21swapper/307:14:033
470124737,0sleep10-21swapper/107:17:251
475024637,0sleep20-21swapper/207:18:022
462723423,0sleep00-21swapper/007:16:360
48559974,0cyclictest30351-21munin-run08:43:210
339970,0migration/314305-21sh11:27:443
48559965,0cyclictest8376-21grep11:58:500
339960,0migration/331372-21sh10:21:393
339960,0migration/324568-21munin-node07:53:393
339960,0migration/322026-21sh10:14:413
339960,0migration/313627-21sh12:41:093
339960,0migration/310949-21munin-node10:48:343
29815060,0irq/29-eth0-tx-19676-21munin-node08:13:390
29805060,0irq/28-eth0-rx-20691-21kthreadcore10:33:423
29805060,0irq/28-eth0-rx-20669-21iostat_ios07:28:373
29805060,0irq/28-eth0-rx-1053-21if_eth1.310:23:383
149960,0migration/07210-21sh10:25:260
149960,0migration/029992-21kthreadcore10:58:390
149960,0migration/019536-21unixbench_singl09:53:480
149960,0migration/016946-21aten_r1power_cu11:48:340
149960,0migration/013673-21sh11:25:560
48579954,0cyclictest3524-21snmpd09:07:382
48579954,0cyclictest17384-21cut09:18:362
48569950,0cyclictest0-21swapper/112:30:261
48569950,0cyclictest0-21swapper/112:23:111
48569950,0cyclictest0-21swapper/110:05:051
48569950,0cyclictest0-21swapper/109:20:091
48559955,0cyclictest0-21swapper/009:08:240
48559950,0cyclictest0-21swapper/011:07:170
48559950,0cyclictest0-21swapper/009:40:340
48559950,0cyclictest0-21swapper/009:34:160
339950,0migration/38410-21kthreadcore09:48:403
339950,0migration/38054-21missed_timers10:43:443
339950,0migration/36412-21kthreadcore11:03:403
339950,0migration/36222-21hwlatdetect08:03:373
339950,0migration/34156-21munin-node12:33:483
339950,0migration/33959-21smart_nvme0n111:18:453
339950,0migration/332545-21kthreadcore10:03:383
339950,0migration/33192-21kthreadcore07:38:393
339950,0migration/331552-21kthreadcore10:38:403
339950,0migration/329872-21kthreadcore09:43:393
339950,0migration/32840-21if_eth1.208:23:373
339950,0migration/324524-21if_eth108:38:373
339950,0migration/323522-21munin-node11:33:343
339950,0migration/322422-21munin-node08:33:463
339950,0migration/320383-21munin-node10:53:363
339950,0migration/315963-21taskset07:48:233
339950,0migration/315501-21munin-node08:28:473
339950,0migration/315167-21munin-node12:43:373
339950,0migration/314742-21latency_hist11:28:233
339950,0migration/31440-21kthreadcore11:38:383
339950,0migration/314254-21kthreadcore12:23:413
339950,0migration/314174-21kthreadcore09:33:403
339950,0migration/313190-21cpuspeed_turbos09:53:343
339950,0migration/312555-21kthreadcore09:13:403
329950,0watchdog/328045-21iostat08:18:373
329950,0watchdog/322917-21kthreadcore08:13:413
329950,0watchdog/311340-21cut10:08:413
29815050,0irq/29-eth0-tx-8457-21ssh11:43:352
29815050,0irq/29-eth0-tx-30074-21cpuspeed_turbos12:33:342
29815050,0irq/29-eth0-tx-30053-21munin-node10:03:462
29815050,0irq/29-eth0-tx-15977-21munin-node07:48:490
29815050,0irq/29-eth0-tx-15846-21ssh12:03:402
29815050,0irq/29-eth0-tx-12229-21ssh11:07:452
29815050,0irq/29-eth0-tx-0-21swapper/212:43:562
29815050,0irq/29-eth0-tx-0-21swapper/212:10:542
29815050,0irq/29-eth0-tx-0-21swapper/210:52:092
29815050,0irq/29-eth0-tx-0-21swapper/209:59:152
29815050,0irq/29-eth0-tx-0-21swapper/209:37:112
29815050,0irq/29-eth0-tx-0-21swapper/008:36:140
29815050,0irq/29-eth0-tx-0-21swapper/008:26:470
29815050,0irq/29-eth0-tx-0-21swapper/008:03:450
29815050,0irq/29-eth0-tx-0-21swapper/007:53:390
29805050,0irq/28-eth0-rx-9229-21perl11:43:373
29805050,0irq/28-eth0-rx-8716-21munin-node10:28:353
29805050,0irq/28-eth0-rx-31888-21cut07:58:393
29805050,0irq/28-eth0-rx-25280-21aten_r1power_vo09:23:353
29805050,0irq/28-eth0-rx-21469-21cut11:13:353
29805050,0irq/28-eth0-rx-20898-21irqrtprio09:38:383
29805050,0irq/28-eth0-rx-173942sleep312:04:343
29805050,0irq/28-eth0-rx-10651-21kthreadcore08:48:403
29805050,0irq/28-eth0-rx-0-21swapper/312:00:543
29805050,0irq/28-eth0-rx-0-21swapper/311:10:003
29805050,0irq/28-eth0-rx-0-21swapper/309:18:383
259950,0migration/229717-21sh09:23:422
259950,0migration/22969-21irqcore09:28:382
259950,0migration/219857-21sh12:25:332
249950,0watchdog/226465-21kthreadcore11:13:412
149950,0migration/09049-21kthreadcore07:18:390
149950,0migration/07552-21if_eth1.210:08:380
149950,0migration/06784-21taskset11:39:530
149950,0migration/05324-21sh10:06:150
149950,0migration/05036-21sh11:20:460
149950,0migration/03541-21ntp_kernel_pll_12:33:420
149950,0migration/032159-21kthreadcore09:03:420
149950,0migration/031829-21kthreadcore07:33:410
149950,0migration/030299-21latency_hist07:58:210
149950,0migration/02886-21munin-node09:28:380
149950,0migration/028557-21sh09:59:490
149950,0migration/028311-21sh12:30:050
149950,0migration/027178-21kthreadcore11:33:400
149950,0migration/027129-21irqcore10:38:380
149950,0migration/026282-21fschecks_time11:53:370
149950,0migration/02395-21sh09:44:020
149950,0migration/023873-21kthreadcore11:13:410
149950,0migration/023853-21kthreadcore08:58:410
149950,0migration/021773-21taskset10:13:570
149950,0migration/021182-21sendmail_mailst11:28:440
149950,0migration/016911-21fschecks_count09:18:350
149950,0migration/015926-21kthreadcore12:03:400
149950,0migration/015559-21kthreadcore10:48:400
149950,0migration/01509-21latency_hist08:23:210
149950,0migration/014944-21kthreadcore08:08:420
149950,0migration/014233-21irqrtprio11:08:380
149950,0migration/012797-21sh12:38:480
149950,0migration/010445-21kthreadcore11:43:400
8305040,0irq/26-0000:00:0-21swapper/309:09:223
48579943,0cyclictest3524-21snmpd09:12:382
48579943,0cyclictest3250-21irqbalance12:18:292
48579943,0cyclictest3250-21irqbalance10:58:292
48579943,0cyclictest3250-21irqbalance10:08:292
48579943,0cyclictest3250-21irqbalance09:48:382
48579943,0cyclictest3250-21irqbalance08:53:382
48579943,0cyclictest3250-21irqbalance08:48:582
48579943,0cyclictest3250-21irqbalance08:29:582
48579943,0cyclictest3250-21irqbalance08:23:582
48579943,0cyclictest3250-21irqbalance08:22:082
48579943,0cyclictest3250-21irqbalance08:13:282
48579943,0cyclictest3250-21irqbalance08:09:182
48579943,0cyclictest3250-21irqbalance08:03:282
48579943,0cyclictest3250-21irqbalance07:48:382
48579943,0cyclictest3250-21irqbalance07:38:482
48579943,0cyclictest3250-21irqbalance07:33:282
48579943,0cyclictest3250-21irqbalance07:28:282
48579943,0cyclictest3250-21irqbalance07:18:382
48579943,0cyclictest31476-21awk07:58:372
48579943,0cyclictest28751-21awk12:13:372
48579943,0cyclictest20934-21awk08:58:382
48579943,0cyclictest20421-21awk09:38:372
48569944,0cyclictest2871-21irqrtprio07:38:391
48569944,0cyclictest0-21swapper/111:46:081
48569944,0cyclictest0-21swapper/111:13:301
48569944,0cyclictest0-21swapper/110:45:361
48569944,0cyclictest0-21swapper/109:29:271
48569943,0cyclictest7375-21awk11:23:381
48569943,0cyclictest3571-21lldpd10:49:181
48569943,0cyclictest3571-21lldpd10:31:181
48569943,0cyclictest3571-21lldpd10:25:481
48569943,0cyclictest3571-21lldpd10:09:181
48569943,0cyclictest3571-21lldpd09:58:171
48569943,0cyclictest3571-21lldpd09:45:171
48569943,0cyclictest3571-21lldpd09:41:171
48569943,0cyclictest3571-21lldpd08:50:471
48569943,0cyclictest3571-21lldpd08:25:171
48569943,0cyclictest3571-21lldpd08:10:171
48569943,0cyclictest3571-21lldpd07:52:461
48569943,0cyclictest3571-21lldpd07:43:461
48569943,0cyclictest3571-21lldpd07:28:461
48569943,0cyclictest3524-21snmpd11:18:541
48569943,0cyclictest3524-21snmpd10:53:241
48569943,0cyclictest3524-21snmpd10:18:541
48569943,0cyclictest3524-21snmpd09:05:531
48569943,0cyclictest3524-21snmpd08:42:531
48569943,0cyclictest3524-21snmpd08:22:531
48569943,0cyclictest3524-21snmpd07:18:521
48569943,0cyclictest3250-21irqbalance10:38:091
48569943,0cyclictest31682-21awk08:43:391
48569943,0cyclictest27797-21awk07:33:391
48569943,0cyclictest18041-21awk11:48:381
48569943,0cyclictest17334-21awk08:33:371
48569943,0cyclictest15784-21awk12:43:391
48569943,0cyclictest11708-21awk09:33:381
48569943,0cyclictest10043-21awk08:28:371
48559944,0cyclictest0-21swapper/012:19:100
48559944,0cyclictest0-21swapper/010:46:380
48559943,0cyclictest6530-21awk08:48:370
48559943,0cyclictest3571-21lldpd10:35:480
48559943,0cyclictest3571-21lldpd09:28:170
48559943,0cyclictest24690-21awk10:18:370
48559943,0cyclictest23059-21munin-run12:48:230
48559943,0cyclictest20183-21awk12:08:400
48559943,0cyclictest13811-21awk08:53:380
48559943,0cyclictest13470-21awk07:23:380
339940,0migration/327797-21kthreadcore11:53:413
339940,0migration/317706-21kthreadcore07:23:403
329940,0watchdog/323948-21tr08:58:413
329940,0watchdog/30-21swapper/312:13:423
329940,0watchdog/30-21swapper/312:08:423
29815040,0irq/29-eth0-tx-21146-21ssh12:28:302
29815040,0irq/29-eth0-tx-0-21swapper/212:39:412
29815040,0irq/29-eth0-tx-0-21swapper/211:52:202
29815040,0irq/29-eth0-tx-0-21swapper/211:40:102
29815040,0irq/29-eth0-tx-0-21swapper/211:33:292
29815040,0irq/29-eth0-tx-0-21swapper/211:28:342
29815040,0irq/29-eth0-tx-0-21swapper/211:23:242
29815040,0irq/29-eth0-tx-0-21swapper/211:18:362
29815040,0irq/29-eth0-tx-0-21swapper/211:08:332
29815040,0irq/29-eth0-tx-0-21swapper/210:44:052
29815040,0irq/29-eth0-tx-0-21swapper/210:38:592
29815040,0irq/29-eth0-tx-0-21swapper/210:33:332
29815040,0irq/29-eth0-tx-0-21swapper/210:28:312
29815040,0irq/29-eth0-tx-0-21swapper/210:23:342
29815040,0irq/29-eth0-tx-0-21swapper/210:18:502
29815040,0irq/29-eth0-tx-0-21swapper/209:43:432
29815040,0irq/29-eth0-tx-0-21swapper/008:28:420
29815040,0irq/29-eth0-tx-0-21swapper/007:43:420
29815040,0irq/29-eth0-tx-0-21swapper/007:28:420
29805040,0irq/28-eth0-rx-0-21swapper/312:28:313
29805040,0irq/28-eth0-rx-0-21swapper/312:21:093
29805040,0irq/28-eth0-rx-0-21swapper/311:48:333
29805040,0irq/28-eth0-rx-0-21swapper/311:01:253
29805040,0irq/28-eth0-rx-0-21swapper/309:58:293
29805040,0irq/28-eth0-rx-0-21swapper/309:29:043
29805040,0irq/28-eth0-rx-0-21swapper/307:33:353
29805040,0irq/28-eth0-rx-0-21swapper/307:18:393
259940,0migration/27800-21munin-node11:58:442
259940,0migration/2553-21kthreadcore08:43:412
259940,0migration/229183-21latency08:38:402
259940,0migration/227671-21kthreadcore07:53:402
259940,0migration/219162-21latency_hist10:53:222
259940,0migration/217361-21irqcore08:33:382
259940,0migration/215994-21kthreadcore09:53:402
249940,0watchdog/230132-21kthreadcore11:53:422
249940,0watchdog/218833-21yum07:23:492
249940,0watchdog/214948-21ssh10:13:292
249940,0watchdog/211422-21kthreadcore07:43:412
179940,0migration/124553-21irqcore07:53:391
169940,0watchdog/126805-21kthreadcore09:23:411
169940,0watchdog/116116-21kthreadcore12:23:421
169940,0watchdog/114618-21kthreadcore09:13:411
169940,0watchdog/110569-21cpu12:03:341
169940,0watchdog/10-21swapper/112:08:381
169940,0watchdog/10-21swapper/111:38:461
169940,0watchdog/10-21swapper/111:33:331
169940,0watchdog/10-21swapper/108:58:411
149940,0migration/029249-21sh12:13:380
149940,0migration/015306-21kthreadcore12:23:410
149940,0migration/014504-21kthreadcore09:13:410
48569933,0cyclictest0-21swapper/111:59:131
48569932,0cyclictest6639-21sed08:03:391
48569932,0cyclictest30630-21grep07:58:341
48569932,0cyclictest28727-21awk12:13:361
48569932,0cyclictest21249-21kthreadcore08:13:401
48569932,0cyclictest13398-21awk07:23:371
48569930,0cyclictest26483-21perl11:53:371
48569930,0cyclictest15631-21grep11:28:361
48569930,0cyclictest0-21swapper/109:08:291
48559933,0cyclictest29194-21kworker/0:007:38:290
48559933,0cyclictest25864-21kworker/0:009:48:330
48559933,0cyclictest25864-21kworker/0:008:43:230
48559932,0cyclictest20312-21awk10:53:360
329930,0watchdog/30-21swapper/308:53:373
329930,0watchdog/30-21swapper/307:43:413
29805030,0irq/28-eth0-rx-0-21swapper/309:03:463
29805030,0irq/28-eth0-rx-0-21swapper/308:43:353
29805030,0irq/28-eth0-rx-0-21swapper/308:11:453
249930,0watchdog/20-21swapper/209:13:412
179930,0migration/129894-21sh12:33:331
179930,0migration/126254-21fschecks_count10:38:341
169930,0watchdog/16062-21ssh12:38:301
169930,0watchdog/10-21swapper/111:08:331
169930,0watchdog/10-21swapper/111:03:411
169930,0watchdog/10-21swapper/110:58:491
169930,0watchdog/10-21swapper/110:13:371
169930,0watchdog/10-21swapper/109:58:251
169930,0watchdog/10-21swapper/109:48:331
169930,0watchdog/10-21swapper/108:53:371
149930,0migration/08536-21sh10:28:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional