You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-30 - 21:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Tue Dec 30, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
697227875,0sleep00-21swapper/007:11:280
696225248,0sleep20-21swapper/207:11:222
657424131,0sleep30-21swapper/307:07:023
7040993636,0cyclictest4829-21md1_resync11:50:350
676923626,0sleep10-21swapper/107:09:121
7041992525,0cyclictest4830-21md0_resync11:50:351
70459976,0cyclictest11611-21munin-node10:51:452
70459970,0cyclictest0-21swapper/208:20:432
8305060,0irq/26-0000:00:9879-21ssh12:17:103
8305060,0irq/26-0000:00:398-21kthreadcore09:51:483
8305060,0irq/26-0000:00:26947-21sh11:35:283
8305060,0irq/26-0000:00:20798-21tr12:06:503
8305060,0irq/26-0000:00:17114-21python10:51:543
8305060,0irq/26-0000:00:13202-21iostat_ios12:21:483
8305060,0irq/26-0000:00:12692-21grep10:16:423
8305060,0irq/26-0000:00:12514-21grep10:31:493
8305060,0irq/26-0000:00:0-21swapper/311:51:563
70459966,0cyclictest0-21swapper/212:37:132
70459966,0cyclictest0-21swapper/211:51:212
35160,0ktimersoftd/30-21swapper/311:59:263
35160,0ktimersoftd/30-21swapper/308:36:413
339960,0migration/329163-21sh10:25:283
339960,0migration/324947-21sh10:04:553
339960,0migration/319372-21sh09:41:543
339960,0migration/317693-21sh11:30:013
29805060,0irq/28-eth0-rx-5115-21kernelversion09:36:463
29805060,0irq/28-eth0-rx-26961-21diskstats09:31:443
149960,0migration/08551-21latency_hist07:56:290
149960,0migration/03668-21sh11:02:490
149960,0migration/031144-21kthreadcore08:31:470
149960,0migration/025004-21cpuspeed_turbos10:41:440
149960,0migration/017879-21sh10:52:550
8305050,0irq/26-0000:00:7589-21kthreadcore11:06:483
8305050,0irq/26-0000:00:6645-21cut07:31:473
8305050,0irq/26-0000:00:6093-21df_abs08:16:433
8305050,0irq/26-0000:00:29646-21python08:06:573
8305050,0irq/26-0000:00:29101-21ps11:36:463
8305050,0irq/26-0000:00:28708-21sh11:01:323
8305050,0irq/26-0000:00:27285-21tr07:21:463
8305050,0irq/26-0000:00:23725-21ssh11:16:423
8305050,0irq/26-0000:00:22634-21users08:01:563
8305050,0irq/26-0000:00:2194-21kthreadcore12:31:483
8305050,0irq/26-0000:00:17355-21kthreadcore09:06:483
8305050,0irq/26-0000:00:15521-21sed07:16:433
8305050,0irq/26-0000:00:15060-21df_inode11:11:423
8305050,0irq/26-0000:00:14704-21kthreadcore08:21:463
8305050,0irq/26-0000:00:12954-21kthreadcore09:01:483
8305050,0irq/26-0000:00:12069-21ssh11:43:583
8305050,0irq/26-0000:00:12069-21ssh11:43:583
8305050,0irq/26-0000:00:11952-21kthreadcore07:56:463
8305050,0irq/26-0000:00:11073-21kthreadcore09:56:473
8305050,0irq/26-0000:00:0-21swapper/312:11:483
8305050,0irq/26-0000:00:0-21swapper/307:40:413
70459955,0cyclictest0-21swapper/211:42:402
70459955,0cyclictest0-21swapper/211:42:402
70459955,0cyclictest0-21swapper/211:06:442
70459955,0cyclictest0-21swapper/209:50:062
70459950,0cyclictest0-21swapper/212:29:022
70459950,0cyclictest0-21swapper/211:32:542
70459950,0cyclictest0-21swapper/208:30:392
70419954,0cyclictest3250-21irqbalance07:24:151
70419950,0cyclictest0-21swapper/112:12:291
70419950,0cyclictest0-21swapper/112:00:581
70419950,0cyclictest0-21swapper/110:36:001
70409950,0cyclictest0-21swapper/010:16:100
70409950,0cyclictest0-21swapper/009:31:430
339950,0migration/326401-21fschecks_count10:06:453
339950,0migration/325421-21kthreadcore09:11:473
339950,0migration/325048-21ntp_kernel_err07:41:493
339950,0migration/322619-21taskset10:37:073
339950,0migration/321159-21cpu12:26:423
339950,0migration/320134-21kthreadcore09:26:483
339950,0migration/316517-21timerandwakeup08:41:563
329950,0watchdog/33926-21kthreadcore09:16:483
329950,0watchdog/326196-21munin-node10:41:483
329950,0watchdog/325138-21diskstats08:51:443
329950,0watchdog/317911-21fschecks_count08:46:443
329950,0watchdog/30-21swapper/308:11:523
29815050,0irq/29-eth0-tx-3524-21snmpd07:11:580
29815050,0irq/29-eth0-tx-32469-21kthreadcore12:31:482
29815050,0irq/29-eth0-tx-31108-21port_sshpriv10:41:532
29815050,0irq/29-eth0-tx-30075-21ssh11:53:592
29815050,0irq/29-eth0-tx-22950-21ssh10:37:542
29815050,0irq/29-eth0-tx-20362-21munin-node08:26:420
29815050,0irq/29-eth0-tx-10615-21cut12:01:482
29815050,0irq/29-eth0-tx-0-21swapper/211:14:402
29815050,0irq/29-eth0-tx-0-21swapper/210:49:522
29815050,0irq/29-eth0-tx-0-21swapper/210:17:372
29815050,0irq/29-eth0-tx-0-21swapper/210:08:292
29815050,0irq/29-eth0-tx-0-21swapper/009:06:510
29815050,0irq/29-eth0-tx-0-21swapper/007:48:200
29815050,0irq/29-eth0-tx-0-21swapper/007:36:480
29805050,0irq/28-eth0-rx-9892-21tr12:01:483
29805050,0irq/28-eth0-rx-6314-21runrttasks09:22:513
29805050,0irq/28-eth0-rx-2507-21kthreadcore10:26:503
29805050,0irq/28-eth0-rx-22309-21df09:46:423
29805050,0irq/28-eth0-rx-15016-21kthreadcore11:46:473
29805050,0irq/28-eth0-rx-0-21swapper/312:36:563
29805050,0irq/28-eth0-rx-0-21swapper/311:21:433
29805050,0irq/28-eth0-rx-0-21swapper/310:56:293
29805050,0irq/28-eth0-rx-0-21swapper/310:47:033
29805050,0irq/28-eth0-rx-0-21swapper/310:11:503
27150,0ktimersoftd/20-21swapper/207:17:302
259950,0migration/29573-21kthreadcore09:21:482
259950,0migration/29550-21runrttasks08:38:402
259950,0migration/29231-21irqrtprio09:56:462
259950,0migration/232605-21munin-node11:56:462
259950,0migration/229589-21munin-node08:06:542
259950,0migration/229226-21kthreadcore09:31:492
259950,0migration/22852-21ksmtuned12:16:412
259950,0migration/227962-21kthreadcore12:11:482
259950,0migration/220520-21munin-node07:41:462
259950,0migration/218929-21kthreadcore09:26:472
249950,0watchdog/27496-21cut10:31:442
249950,0watchdog/230246-21df10:26:442
249950,0watchdog/229919-21ssh09:15:082
249950,0watchdog/217214-21munin-node12:06:492
249950,0watchdog/216046-21python11:26:522
19150,0ktimersoftd/10-21swapper/112:08:411
19150,0ktimersoftd/10-21swapper/111:10:411
179950,0migration/17703-21gltestperf12:36:431
179950,0migration/131634-21fschecks_count09:51:441
179950,0migration/123929-21kthreadcore08:26:471
179950,0migration/123270-21latency08:46:491
179950,0migration/120930-21kthreadcore11:31:481
179950,0migration/118882-21latency_hist07:41:291
179950,0migration/116826-21kthreadcore07:16:471
179950,0migration/115336-21kthreadcore12:21:501
179950,0migration/112793-21idleruntime10:16:431
169950,0watchdog/121224-21kthreadcore10:01:481
169950,0watchdog/120335-21ssh09:26:481
169950,0watchdog/118029-21kthreadcore09:06:481
169950,0watchdog/10-21swapper/108:41:441
149950,0migration/07201-21kthreadcore07:31:480
149950,0migration/06760-21sh09:19:480
149950,0migration/06479-21sh09:54:070
149950,0migration/05918-21taskset10:30:350
149950,0migration/05546-21kthreadcore11:21:480
149950,0migration/0453-21unixbench-2d12:11:570
149950,0migration/030713-21sh11:17:120
149950,0migration/028419-21kthreadcore08:51:490
149950,0migration/024695-21kthreadcore07:21:450
149950,0migration/023459-21kthreadcore09:11:460
149950,0migration/022889-21kthreadcore07:41:470
149950,0migration/022392-21kthreadcore09:26:480
149950,0migration/020681-21sh10:56:450
149950,0migration/017463-21cpuspeed_turbos12:06:440
149950,0migration/015372-21kthreadcore08:21:470
149950,0migration/01469-21kthreadcore08:56:450
149950,0migration/014504-21latency_hist11:11:290
149950,0migration/013537-21kthreadcore08:41:480
149950,0migration/01321-21taskset10:09:080
149950,0migration/012627-21munin-node12:21:450
149950,0migration/011168-21sh12:20:190
149950,0migration/010977-21kthreadcore12:01:480
8305040,0irq/26-0000:00:0-21swapper/308:56:393
8305040,0irq/26-0000:00:0-21swapper/308:31:443
8305040,0irq/26-0000:00:0-21swapper/307:11:463
70459944,0cyclictest0-21swapper/209:51:322
70459944,0cyclictest0-21swapper/209:16:412
70459944,0cyclictest0-21swapper/208:45:472
70459943,0cyclictest3571-21lldpd08:35:482
70459943,0cyclictest15662-21awk09:06:462
70419944,0cyclictest0-21swapper/109:56:351
70419943,0cyclictest9679-21awk07:56:441
70419943,0cyclictest5457-21awk11:41:461
70419943,0cyclictest5457-21awk11:41:461
70419943,0cyclictest3763-21awk08:36:471
70419943,0cyclictest3571-21lldpd09:37:211
70419943,0cyclictest3250-21irqbalance12:18:461
70419943,0cyclictest3250-21irqbalance10:21:461
70419943,0cyclictest3250-21irqbalance09:43:151
70419943,0cyclictest3250-21irqbalance09:32:151
70419943,0cyclictest3250-21irqbalance07:39:151
70419943,0cyclictest3250-21irqbalance07:31:351
70419943,0cyclictest31074-21awk12:31:451
70419943,0cyclictest28756-21awk08:31:441
70419943,0cyclictest28737-21awk11:36:441
70419943,0cyclictest2261-21awk07:51:441
70419943,0cyclictest20748-21awk10:56:461
70409944,0cyclictest0-21swapper/007:18:580
70409943,0cyclictest7802-21awk10:31:460
70409943,0cyclictest3571-21lldpd09:45:520
70409943,0cyclictest3571-21lldpd09:37:210
70409943,0cyclictest3524-21snmpd10:41:250
70409943,0cyclictest3524-21snmpd07:54:520
70409943,0cyclictest23495-21awk11:51:460
339940,0migration/332644-21kthreadcore07:26:473
329940,0watchdog/330489-21kthreadcore07:46:483
29815040,0irq/29-eth0-tx-3458-21ssh09:36:372
29815040,0irq/29-eth0-tx-0-21swapper/212:21:332
29815040,0irq/29-eth0-tx-0-21swapper/211:36:392
29815040,0irq/29-eth0-tx-0-21swapper/211:22:212
29815040,0irq/29-eth0-tx-0-21swapper/211:01:322
29815040,0irq/29-eth0-tx-0-21swapper/210:56:332
29815040,0irq/29-eth0-tx-0-21swapper/210:22:022
29815040,0irq/29-eth0-tx-0-21swapper/210:11:352
29815040,0irq/29-eth0-tx-0-21swapper/009:04:210
29805040,0irq/28-eth0-rx-0-21swapper/307:51:403
259940,0migration/226894-21fschecks_count07:46:432
259940,0migration/225436-21kthreadcore11:16:502
259940,0migration/22387-21kthreadcore08:56:452
259940,0migration/217297-21fschecks_count10:01:432
259940,0migration/215629-21runrttasks08:00:322
259940,0migration/212998-21aten_r1power_po09:41:422
249940,0watchdog/2717-21kthreadcore07:26:482
249940,0watchdog/212013-21cut09:01:482
249940,0watchdog/20-21swapper/208:46:482
249940,0watchdog/20-21swapper/208:01:482
249940,0watchdog/20-21swapper/207:31:562
179940,0migration/13944-21taskset11:03:281
179940,0migration/13461-21kthreadcore10:46:481
179940,0migration/132642-21fschecks_count08:56:411
179940,0migration/130206-21kthreadcore08:51:491
179940,0migration/130117-21kthreadcore07:46:481
179940,0migration/128657-21kthreadcore10:06:491
179940,0migration/126398-21kthreadcore11:16:501
179940,0migration/124517-21kthreadcore09:46:461
179940,0migration/122923-21munin-node09:11:451
179940,0migration/119214-21kthreadcore11:11:471
179940,0migration/116367-21kthreadcore08:21:471
179940,0migration/111111-21kthreadcore07:11:471
169940,0watchdog/19288-21irqrtprio09:21:481
169940,0watchdog/15500-21ssh09:17:081
169940,0watchdog/128838-21ssh12:29:251
169940,0watchdog/126887-21kthreadcore11:51:481
169940,0watchdog/115542-21ssh12:03:131
169940,0watchdog/10-21swapper/111:21:481
169940,0watchdog/10-21swapper/110:51:481
169940,0watchdog/10-21swapper/110:41:561
169940,0watchdog/10-21swapper/108:11:521
169940,0watchdog/10-21swapper/107:26:481
149940,0migration/022708-21kthreadcore10:21:470
149940,0migration/019522-21kthreadcore10:01:480
149940,0migration/018744-21irqcore08:46:470
149940,0migration/018453-21kthreadcore08:01:470
149940,0migration/011531-21kthreadcore09:56:470
8305030,0irq/26-0000:00:0-21swapper/308:26:303
70459930,0cyclictest13729-21perl08:21:432
70459930,0cyclictest0-21swapper/207:23:292
70419932,0cyclictest3571-21lldpd08:17:181
70419932,0cyclictest24865-21irqstats08:06:501
70419930,0cyclictest13541-21kthreadcore11:26:481
70409933,0cyclictest5576-21kworker/0:212:36:350
70409933,0cyclictest5576-21kworker/0:212:32:130
70409933,0cyclictest3571-21lldpd11:57:240
70409933,0cyclictest31978-21kworker/0:110:46:420
70409933,0cyclictest31978-21kworker/0:110:16:580
70409933,0cyclictest31978-21kworker/0:109:22:060
70409933,0cyclictest31978-21kworker/0:108:16:460
70409933,0cyclictest24724-21kworker/0:011:27:450
70409932,0cyclictest8756-21grep11:41:480
70409932,0cyclictest8756-21grep11:41:480
70409932,0cyclictest6644-21awk11:06:460
70409932,0cyclictest28794-21awk11:36:450
70409932,0cyclictest23045-21awk09:46:440
70409932,0cyclictest2209-21grep07:26:480
70409932,0cyclictest21279-21tr12:26:430
70409932,0cyclictest19693-21awk11:31:460
29815030,0irq/29-eth0-tx-0-21swapper/008:36:430
29815030,0irq/29-eth0-tx-0-21swapper/008:11:410
29815030,0irq/29-eth0-tx-0-21swapper/008:06:450
249930,0watchdog/24668-21smartctlcvt08:11:522
249930,0watchdog/20-21swapper/208:52:402
249930,0watchdog/20-21swapper/207:39:322
249930,0watchdog/20-21swapper/207:11:362
19130,0ktimersoftd/14626-21sh10:27:301
169930,0watchdog/10-21swapper/110:38:081
169930,0watchdog/10-21swapper/110:11:321
169930,0watchdog/10-21swapper/109:01:481
169930,0watchdog/10-21swapper/108:01:481
249920,0watchdog/20-21swapper/207:51:322
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional