You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 20:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue Mar 24, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
669026059,0sleep20-21swapper/207:15:212
7041994848,0cyclictest28394-21md1_resync09:43:500
7043993737,0cyclictest271ktimersoftd/209:43:502
665223525,0sleep10-21swapper/107:14:521
675023228,0sleep30-21swapper/307:15:583
665122925,0sleep00-21swapper/007:14:510
7042992322,0cyclictest8228-21ssh09:43:501
8305060,0irq/26-0000:00:9230-21sh09:45:383
8305060,0irq/26-0000:00:9017-21df_inode11:38:413
8305060,0irq/26-0000:00:32560-21open_inodes07:53:473
8305060,0irq/26-0000:00:27198-21kthreadcore12:43:453
8305060,0irq/26-0000:00:26492-21diskstats11:48:383
8305060,0irq/26-0000:00:25387-21python07:48:483
8305060,0irq/26-0000:00:23025-21if_err_eth009:18:443
8305060,0irq/26-0000:00:21944-21kthreadcore09:33:473
8305060,0irq/26-0000:00:1746-21sensors_volt08:38:483
8305060,0irq/26-0000:00:15713-21if_eth107:23:433
8305060,0irq/26-0000:00:1571-21tune2fs10:38:413
8305060,0irq/26-0000:00:14487-21ssh10:25:313
8305060,0irq/26-0000:00:13965-21yum09:08:553
8305060,0irq/26-0000:00:13122-21grep11:03:433
8305060,0irq/26-0000:00:11826-21munin-run11:03:273
8305060,0irq/26-0000:00:0-21swapper/309:50:463
70439965,0cyclictest22389-21munin-node07:28:392
70429960,0cyclictest0-21swapper/112:04:131
70429960,0cyclictest0-21swapper/111:16:361
70429960,0cyclictest0-21swapper/110:39:331
70429960,0cyclictest0-21swapper/109:06:131
70429960,0cyclictest0-21swapper/107:54:571
339960,0migration/34558-21munin-node08:18:473
339960,0migration/329502-21sh10:16:003
339960,0migration/325164-21sh09:38:343
339960,0migration/315124-21sh12:35:583
149960,0migration/06557-21sh10:22:450
8305050,0irq/26-0000:00:9612-21cut08:23:473
8305050,0irq/26-0000:00:9342-21fschecks_count08:03:413
8305050,0irq/26-0000:00:9293-21cut09:28:443
8305050,0irq/26-0000:00:8044-21grep07:58:523
8305050,0irq/26-0000:00:584-21kthreadcore12:28:463
8305050,0irq/26-0000:00:5802-21ssh11:18:283
8305050,0irq/26-0000:00:26438-21kthreadcore08:58:453
8305050,0irq/26-0000:00:26074-21kthreadcore10:33:443
8305050,0irq/26-0000:00:23611-21cpuspeed_turbos11:28:393
8305050,0irq/26-0000:00:23446-21sed07:28:433
8305050,0irq/26-0000:00:22337-21irqrtprio11:08:453
8305050,0irq/26-0000:00:21342-21chrt09:14:283
8305050,0irq/26-0000:00:16954-21ssh10:45:203
8305050,0irq/26-0000:00:14438-21perl12:18:423
8305050,0irq/26-0000:00:13717-21tr11:58:433
8305050,0irq/26-0000:00:0-21swapper/312:23:403
8305050,0irq/26-0000:00:0-21swapper/312:08:403
8305050,0irq/26-0000:00:0-21swapper/310:01:043
8305050,0irq/26-0000:00:0-21swapper/308:53:383
8305050,0irq/26-0000:00:0-21swapper/308:28:463
8305050,0irq/26-0000:00:0-21swapper/307:33:443
70439955,0cyclictest0-21swapper/212:02:302
70439955,0cyclictest0-21swapper/209:07:112
70439954,0cyclictest17604-21ssh09:49:362
70439950,0cyclictest0-21swapper/210:03:092
70439950,0cyclictest0-21swapper/208:46:042
70429955,0cyclictest0-21swapper/111:33:571
70429955,0cyclictest0-21swapper/110:22:501
70429955,0cyclictest0-21swapper/110:10:141
70429955,0cyclictest0-21swapper/109:59:491
70429950,0cyclictest0-21swapper/112:37:001
70429950,0cyclictest0-21swapper/112:11:561
70429950,0cyclictest0-21swapper/111:12:581
70419955,0cyclictest0-21swapper/012:08:570
70419955,0cyclictest0-21swapper/011:35:510
70419955,0cyclictest0-21swapper/007:51:110
339950,0migration/330123-21kthreadcore10:53:483
339950,0migration/324751-21irqcore08:13:443
339950,0migration/320962-21munin-node12:03:423
339950,0migration/319736-21timerwakeupswit10:08:523
339950,0migration/316392-21cpuspeed_turbos08:08:403
339950,0migration/316392-21aten_r1power_po12:38:393
339950,0migration/31383-21kthreadcore10:18:453
339950,0migration/312659-21kthreadcore08:48:443
339950,0migration/312250-21diskmemload12:15:043
329950,0watchdog/330198-21perl11:13:423
329950,0watchdog/318553-21interrupts11:43:473
329950,0watchdog/30-21swapper/307:38:463
29815050,0irq/29-eth0-tx-8578-21hddtemp_smartct12:33:432
29815050,0irq/29-eth0-tx-7050-21ssh10:23:292
29815050,0irq/29-eth0-tx-6390-21ssh10:22:182
29815050,0irq/29-eth0-tx-5035-21munin-node12:13:432
29815050,0irq/29-eth0-tx-27827-21munin-node08:38:510
29815050,0irq/29-eth0-tx-21703-21crond09:18:260
29815050,0irq/29-eth0-tx-18907-21irqstats11:43:472
29815050,0irq/29-eth0-tx-1636-21cut09:23:452
29815050,0irq/29-eth0-tx-15824-21munin-node10:28:542
29815050,0irq/29-eth0-tx-10219-21fschecks_count10:43:422
29815050,0irq/29-eth0-tx-0-21swapper/212:09:582
29815050,0irq/29-eth0-tx-0-21swapper/211:52:062
29815050,0irq/29-eth0-tx-0-21swapper/211:37:192
29815050,0irq/29-eth0-tx-0-21swapper/211:18:502
29815050,0irq/29-eth0-tx-0-21swapper/210:48:482
29815050,0irq/29-eth0-tx-0-21swapper/008:05:350
29805050,0irq/28-eth0-rx-3300-21cat11:33:473
29805050,0irq/28-eth0-rx-0-21swapper/311:23:313
29805050,0irq/28-eth0-rx-0-21swapper/310:48:323
29805050,0irq/28-eth0-rx-0-21swapper/310:28:313
29805050,0irq/28-eth0-rx-0-21swapper/310:03:353
29805050,0irq/28-eth0-rx-0-21swapper/309:53:523
29805050,0irq/28-eth0-rx-0-21swapper/308:43:453
27150,0ktimersoftd/20-21swapper/207:37:282
259950,0migration/28076-21unixbench_multi07:58:532
259950,0migration/24871-21switchtime08:18:542
259950,0migration/24853-21munin-node10:03:412
259950,0migration/2316-21sh12:46:452
259950,0migration/227189-21aten_r1power_po10:53:412
259950,0migration/227153-21kthreadcore09:38:442
259950,0migration/222969-3199-raid-check08:10:322
259950,0migration/216517-21sh11:42:022
259950,0migration/211839-21kthreadcore09:08:462
259950,0migration/211362-21taskset11:02:102
249950,0watchdog/222902-21hwlatdetect10:13:422
19150,0ktimersoftd/10-21swapper/107:37:281
179950,0migration/19783-21munin-node08:03:421
179950,0migration/18800-21irqcore09:28:441
179950,0migration/129203-21kthreadcore10:33:451
179950,0migration/125719-21munin-node07:48:521
179950,0migration/125679-21sh11:48:111
179950,0migration/121112-21timerwakeupswit07:23:521
179950,0migration/116919-21taskset08:49:051
179950,0migration/114353-21turbostat11:23:271
179950,0migration/114101-21gltestperf08:28:411
179950,0migration/113993-21cpuspeed_turbos12:18:401
179950,0migration/110822-21sh10:03:501
169950,0watchdog/17359-21aten_r1power_fr07:18:381
169950,0watchdog/13276-21grep08:18:461
169950,0watchdog/129570-21kthreadcore08:58:461
149950,0migration/09703-21kthreadcore07:18:440
149950,0migration/08711-21aten_r1power_po11:38:400
149950,0migration/08118-21kthreadcore10:58:470
149950,0migration/07244-21kthreadcore07:38:440
149950,0migration/07120-21aten_r1power_cu10:23:380
149950,0migration/05655-21fschecks_count12:13:410
149950,0migration/04171-21kthreadcore12:28:470
149950,0migration/03864-21kthreadcore09:03:450
149950,0migration/031463-21kthreadcore07:33:440
149950,0migration/031122-21cpuspeed_turbos08:18:400
149950,0migration/027386-21kthreadcore12:43:450
149950,0migration/027289-21kthreadcore08:58:450
149950,0migration/026031-21kthreadcore11:28:450
149950,0migration/024220-21fschecks_time08:13:410
149950,0migration/02376-21taskset10:56:340
149950,0migration/022726-21kthreadcore08:33:460
149950,0migration/022123-21sh12:23:190
149950,0migration/021333-21kthreadcore08:08:470
149950,0migration/019564-21kthreadcore11:43:480
149950,0migration/019375-21aten_r1power_po09:53:390
149950,0migration/017526-21sh10:46:560
149950,0migration/017108-21fschecks_time09:33:420
149950,0migration/016053-21munin-node10:28:410
149950,0migration/014577-21latency_hist07:23:270
149950,0migration/014543-21sh12:34:160
149950,0migration/012715-21taskset08:26:220
149950,0migration/011276-21aten_r1power_en11:58:370
149950,0migration/011161-21hddtemp_smartct08:48:410
149950,0migration/010973-21kthreadcore09:08:460
8305040,0irq/26-0000:00:0-21swapper/308:33:393
8305040,0irq/26-0000:00:0-21swapper/307:43:403
70439944,0cyclictest32738-21sensors07:53:482
70439944,0cyclictest0-21swapper/208:26:122
70439944,0cyclictest0-21swapper/207:43:472
70439943,0cyclictest3524-21snmpd11:14:072
70439943,0cyclictest3524-21snmpd08:53:512
70439943,0cyclictest3524-21snmpd07:49:502
70439943,0cyclictest25624-21awk10:33:432
70439943,0cyclictest21617-21awk08:33:442
70429944,0cyclictest0-21swapper/112:14:091
70429944,0cyclictest0-21swapper/112:00:541
70429944,0cyclictest0-21swapper/109:54:281
70429944,0cyclictest0-21swapper/109:36:391
70429944,0cyclictest0-21swapper/108:56:271
70429943,0cyclictest8409-21awk09:08:441
70429943,0cyclictest3571-21lldpd09:13:381
70429943,0cyclictest3571-21lldpd08:08:361
70429943,0cyclictest3571-21lldpd07:43:351
70419944,0cyclictest0-21swapper/011:13:280
70419944,0cyclictest0-21swapper/009:18:320
70419943,0cyclictest3571-21lldpd10:09:390
70419943,0cyclictest3571-21lldpd09:25:380
70419943,0cyclictest29647-21tail11:48:430
70419943,0cyclictest2510-21awk07:58:420
70419943,0cyclictest20514-21sadc11:08:270
70419943,0cyclictest15697-21awk11:23:440
339940,0migration/31060-21irqcore09:03:443
329940,0watchdog/37361-21aten_r1power_fr07:18:383
329940,0watchdog/30-21swapper/311:53:393
329940,0watchdog/30-21swapper/309:23:463
29815040,0irq/29-eth0-tx-24068-21kthreadcore12:23:452
29815040,0irq/29-eth0-tx-2103-21irqcore10:38:442
29815040,0irq/29-eth0-tx-0-21swapper/212:20:372
29815040,0irq/29-eth0-tx-0-21swapper/212:03:292
29815040,0irq/29-eth0-tx-0-21swapper/211:28:502
29815040,0irq/29-eth0-tx-0-21swapper/211:23:532
29815040,0irq/29-eth0-tx-0-21swapper/211:08:462
29815040,0irq/29-eth0-tx-0-21swapper/209:35:092
29815040,0irq/29-eth0-tx-0-21swapper/209:29:142
29815040,0irq/29-eth0-tx-0-21swapper/008:28:420
29815040,0irq/29-eth0-tx-0-21swapper/007:28:460
259940,0migration/23992-21kthreadcore12:28:472
259940,0migration/231744-21kthreadcore08:38:432
259940,0migration/228893-21kthreadcore08:58:462
259940,0migration/224717-21idleruntime-cro12:43:282
259940,0migration/224220-21kthreadcore09:53:462
259940,0migration/223629-21kthreadcore09:18:462
259940,0migration/217641-21kthreadcore07:23:442
259940,0migration/213980-21fschecks_time10:08:402
259940,0migration/213134-21ksmtuned08:28:282
259940,0migration/211531-21irqcore08:48:432
249940,0watchdog/29587-21ssh11:54:432
249940,0watchdog/27360-21aten_r1power_fr07:18:382
249940,0watchdog/218503-21sendmail_mailtr11:03:502
249940,0watchdog/211225-21sshd07:40:582
179940,0migration/17982-21kthreadcore08:23:471
179940,0migration/16212-21kthreadcore07:58:451
179940,0migration/15963-21kthreadcore10:58:461
179940,0migration/15341-21switchtime12:28:541
179940,0migration/130901-21sh11:30:541
179940,0migration/128581-21fschecks_time08:38:381
179940,0migration/12825-21aten_r1power_en08:43:391
179940,0migration/127760-21kthreadcore09:38:441
179940,0migration/126453-21kthreadcore07:28:441
179940,0migration/124849-21latency_hist12:43:281
179940,0migration/118659-21cpuspeed_turbos10:48:391
179940,0migration/113661-21kthreadcore09:48:451
179940,0migration/111698-21kthreadcore10:23:451
179940,0migration/110945-21kthreadcore11:38:451
169940,0watchdog/14085-21kthreadcore09:23:461
169940,0watchdog/130115-21ssh10:17:421
169940,0watchdog/129684-21ssh09:21:301
169940,0watchdog/12606-21cpu11:53:391
169940,0watchdog/118839-21unixbench_singl11:03:541
169940,0watchdog/116731-21perl10:28:421
169940,0watchdog/10-21swapper/111:23:461
169940,0watchdog/10-21swapper/110:43:461
169940,0watchdog/10-21swapper/108:13:461
169940,0watchdog/10-21swapper/107:38:461
149940,0migration/09943-21kthreadcore11:18:480
149940,0migration/032530-21ntp_offset07:53:470
149940,0migration/029824-21kthreadcore09:38:450
149940,0migration/025925-21kthreadcore12:03:460
149940,0migration/025864-21kthreadcore11:08:460
149940,0migration/021338-21kthreadcore08:53:440
149940,0migration/012354-21kthreadcore09:48:450
149940,0migration/010363-21kthreadcore09:28:450
70439932,0cyclictest9876-21awk08:03:432
70439932,0cyclictest15809-21awk09:13:432
70429932,0cyclictest27004-21grep11:48:391
70429932,0cyclictest17355-21awk12:38:431
70419933,0cyclictest31735-21kworker/0:210:03:280
70419933,0cyclictest31735-21kworker/0:209:58:500
70419933,0cyclictest2325-21kworker/0:008:43:280
70419933,0cyclictest22242-21kworker/0:011:53:290
70419933,0cyclictest22242-21kworker/0:010:38:340
70419933,0cyclictest22242-21kworker/0:010:33:340
70419932,0cyclictest3250-21irqbalance12:38:440
70419932,0cyclictest25834-21cut10:13:450
70419932,0cyclictest19425-21awk10:48:420
70419930,0cyclictest22904-21diskstats12:23:410
70419930,0cyclictest11692-21munin-node07:43:390
249930,0watchdog/20-21swapper/208:13:462
169930,0watchdog/10-21swapper/112:23:351
169930,0watchdog/10-21swapper/110:53:301
169930,0watchdog/10-21swapper/108:33:461
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional