You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 17:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Thu Mar 26, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1926025241,0sleep30-21swapper/307:16:323
1937324132,0sleep10-21swapper/107:17:511
1915123622,0sleep00-21swapper/007:15:130
1911723526,0sleep20-21swapper/207:14:512
339960,0migration/37121-21sh11:49:203
339960,0migration/34469-21munin-node10:14:023
339960,0migration/328371-21taskset10:09:403
339960,0migration/315518-21sh10:39:183
339960,0migration/311637-21sh12:29:243
29805060,0irq/28-eth0-rx-6935-21ssh10:34:253
29805060,0irq/28-eth0-rx-11849-21perl12:13:513
29805060,0irq/28-eth0-rx-10629-21if_err_eth1.209:03:523
195129960,0cyclictest0-21swapper/209:24:462
8305050,0irq/26-0000:00:1807-21crond08:13:372
8305050,0irq/26-0000:00:12174-21yum07:54:042
8305050,0irq/26-0000:00:0-21swapper/211:59:002
8305050,0irq/26-0000:00:0-21swapper/211:18:372
339950,0migration/36076-21kernelversion11:14:003
339950,0migration/329763-21munin-node08:28:573
339950,0migration/329372-21munin-node12:23:513
339950,0migration/329011-21irqrtprio08:53:533
339950,0migration/328448-21taskset11:24:123
339950,0migration/323937-21diskmemload11:43:443
339950,0migration/322529-21latency09:08:543
339950,0migration/322380-21kthreadcore08:03:533
339950,0migration/32051-21aten_r1power_cu08:13:463
339950,0migration/318284-21fschecks_time11:58:503
339950,0migration/318069-21kthreadcore07:38:533
339950,0migration/316965-21kthreadcore07:58:553
339950,0migration/316903-21munin-node09:43:583
339950,0migration/316850-21kthreadcore10:23:553
339950,0migration/31474-21kthreadcore12:43:543
329950,0watchdog/3661-21rm12:04:413
329950,0watchdog/35883-21ssh09:20:163
329950,0watchdog/326634-21cut12:38:573
329950,0watchdog/324120-21cut09:48:563
329950,0watchdog/320182-21sh11:20:123
329950,0watchdog/315798-21ssh09:27:563
329950,0watchdog/311123-21ssh09:59:363
29815050,0irq/29-eth0-tx-9065-21munin-node07:33:530
29815050,0irq/29-eth0-tx-8952-21munin-node11:53:572
29815050,0irq/29-eth0-tx-31319-21ssh10:31:222
29815050,0irq/29-eth0-tx-31214-21cat10:13:522
29815050,0irq/29-eth0-tx-23963-21munin-node11:43:582
29815050,0irq/29-eth0-tx-21412-21ssh10:23:592
29815050,0irq/29-eth0-tx-0-21swapper/009:08:460
29815050,0irq/29-eth0-tx-0-21swapper/008:10:460
29815050,0irq/29-eth0-tx-0-21swapper/007:38:480
29805050,0irq/28-eth0-rx-4427-21kthreadcore09:38:563
29805050,0irq/28-eth0-rx-29412-21cat10:48:553
29805050,0irq/28-eth0-rx-25291-21aten_r1power_en09:33:463
29805050,0irq/28-eth0-rx-24926-21if_eth1.210:28:543
29805050,0irq/28-eth0-rx-20850-21ssh10:07:483
29805050,0irq/28-eth0-rx-1922-21latency_hist08:13:373
29805050,0irq/28-eth0-rx-18595-21cut12:33:563
29805050,0irq/28-eth0-rx-13210-21cat10:58:563
29805050,0irq/28-eth0-rx-12580-21ntp_kernel_pll_10:18:563
29805050,0irq/28-eth0-rx-10007-21if_err_eth111:53:523
29805050,0irq/28-eth0-rx-0-21swapper/311:38:513
29805050,0irq/28-eth0-rx-0-21swapper/310:47:513
27150,0ktimersoftd/20-21swapper/209:38:012
195129955,0cyclictest0-21swapper/211:38:562
195129955,0cyclictest0-21swapper/211:32:472
195129955,0cyclictest0-21swapper/211:23:482
195129955,0cyclictest0-21swapper/210:47:142
195129955,0cyclictest0-21swapper/210:07:582
195129955,0cyclictest0-21swapper/209:59:272
195129950,0cyclictest0-21swapper/212:13:372
195129950,0cyclictest0-21swapper/210:37:562
195129950,0cyclictest0-21swapper/210:09:232
195119955,0cyclictest0-21swapper/111:46:551
195119955,0cyclictest0-21swapper/111:19:101
195119955,0cyclictest0-21swapper/110:23:401
195119950,0cyclictest0-21swapper/111:12:421
195119950,0cyclictest0-21swapper/110:30:271
195119950,0cyclictest0-21swapper/109:43:381
195119950,0cyclictest0-21swapper/109:25:301
195109955,0cyclictest23679-21kworker/0:012:46:370
195109955,0cyclictest23679-21kworker/0:012:38:530
195109955,0cyclictest23679-21kworker/0:012:37:450
195109955,0cyclictest23679-21kworker/0:012:28:470
195109955,0cyclictest23679-21kworker/0:012:26:110
195109955,0cyclictest23679-21kworker/0:012:20:530
195109955,0cyclictest23679-21kworker/0:012:13:490
195109955,0cyclictest23679-21kworker/0:012:12:450
195109955,0cyclictest23679-21kworker/0:012:03:550
195109955,0cyclictest23679-21kworker/0:011:58:450
195109955,0cyclictest23679-21kworker/0:011:53:410
195109955,0cyclictest23679-21kworker/0:011:48:470
195109955,0cyclictest23679-21kworker/0:011:46:290
195109955,0cyclictest23679-21kworker/0:011:39:390
195109955,0cyclictest23679-21kworker/0:011:28:570
195109955,0cyclictest23679-21kworker/0:011:18:410
195109955,0cyclictest23679-21kworker/0:011:14:350
195109955,0cyclictest23679-21kworker/0:011:05:310
195109955,0cyclictest23679-21kworker/0:010:59:310
195109955,0cyclictest23679-21kworker/0:010:55:590
195109955,0cyclictest22420-21kworker/0:110:43:420
195109955,0cyclictest22420-21kworker/0:110:38:400
195109955,0cyclictest22420-21kworker/0:110:33:480
195109955,0cyclictest22420-21kworker/0:110:29:280
195109955,0cyclictest22420-21kworker/0:110:23:480
195109955,0cyclictest22420-21kworker/0:110:21:160
195109955,0cyclictest22420-21kworker/0:110:14:200
195109955,0cyclictest22420-21kworker/0:110:11:040
195109955,0cyclictest20231-21kworker/0:010:05:240
195109955,0cyclictest20231-21kworker/0:009:58:420
195109955,0cyclictest20231-21kworker/0:009:54:040
195109955,0cyclictest16029-21kworker/0:209:46:240
195109955,0cyclictest16029-21kworker/0:209:38:520
195109955,0cyclictest16029-21kworker/0:209:29:060
195109955,0cyclictest1039-21kworker/0:109:24:020
195109955,0cyclictest1039-21kworker/0:109:19:320
19150,0ktimersoftd/10-21swapper/111:06:521
179950,0migration/126874-21taskset08:49:141
179950,0migration/126427-21fschecks_count10:48:501
179950,0migration/120493-21fschecks_time12:18:511
179950,0migration/119554-21kthreadcore08:23:551
179950,0migration/113967-21taskset11:35:401
179950,0migration/110550-21munin-node11:14:031
179950,0migration/110301-21idleruntime-cro09:43:371
179950,0migration/110266-21gltestperf08:18:501
149950,0migration/09947-21kthreadcore11:33:550
149950,0migration/06576-21kthreadcore08:58:550
149950,0migration/03711-21kthreadcore07:48:540
149950,0migration/026901-21kthreadcore11:23:560
149950,0migration/026021-21aten_r1power_fr10:48:490
149950,0migration/025704-21munin-node09:33:480
149950,0migration/023894-21aten_r1power_po08:28:490
149950,0migration/019127-21latency_hist09:48:370
149950,0migration/016633-21aten_r1power_fr08:23:490
149950,0migration/015655-21kthreadcore08:43:540
149950,0migration/012723-21kthreadcore09:03:540
149950,0migration/010886-21kthreadcore07:53:550
149950,0migration/010863-21kthreadcore08:38:550
149950,0migration/010863-21kthreadcore08:38:550
339940,0migration/36133-21kthreadcore07:28:533
339940,0migration/35636-21kthreadcore10:53:563
339940,0migration/34934-21runrttasks07:49:093
339940,0migration/328134-21diskmemload11:08:443
339940,0migration/325925-21kthreadcore08:48:543
339940,0migration/325094-21kthreadcore11:03:553
339940,0migration/321689-21kthreadcore08:23:563
329940,0watchdog/311811-21strings08:38:563
329940,0watchdog/311811-21strings08:38:563
329940,0watchdog/30-21swapper/312:08:493
329940,0watchdog/30-21swapper/307:23:563
29815040,0irq/29-eth0-tx-4774-21munin-node12:28:562
29815040,0irq/29-eth0-tx-32694-21ssh10:49:052
29815040,0irq/29-eth0-tx-28377-21ssh12:23:382
29815040,0irq/29-eth0-tx-22003-21ssh12:38:422
29815040,0irq/29-eth0-tx-21125-21kernelversion11:03:532
29815040,0irq/29-eth0-tx-20282-21chrt12:34:342
29815040,0irq/29-eth0-tx-19812-21munin-node12:18:512
29815040,0irq/29-eth0-tx-0-21swapper/211:48:422
29815040,0irq/29-eth0-tx-0-21swapper/211:34:322
29815040,0irq/29-eth0-tx-0-21swapper/211:08:412
29815040,0irq/29-eth0-tx-0-21swapper/210:38:402
29815040,0irq/29-eth0-tx-0-21swapper/210:18:482
29815040,0irq/29-eth0-tx-0-21swapper/209:38:372
29815040,0irq/29-eth0-tx-0-21swapper/209:28:462
29815040,0irq/29-eth0-tx-0-21swapper/007:19:010
29805040,0irq/28-eth0-rx-3613-21kthreadcore11:28:553
29805040,0irq/28-eth0-rx-14112-21kthreadcore08:18:543
29805040,0irq/28-eth0-rx-0-21swapper/312:19:383
29805040,0irq/28-eth0-rx-0-21swapper/311:34:013
29805040,0irq/28-eth0-rx-0-21swapper/309:54:143
29805040,0irq/28-eth0-rx-0-21swapper/309:29:453
259940,0migration/26342-21kthreadcore08:58:552
259940,0migration/25255-21runrttasks07:52:552
259940,0migration/226072-21kthreadcore07:43:542
259940,0migration/221366-21kthreadcore09:48:552
259940,0migration/221071-21irqcore07:18:522
259940,0migration/217095-21fschecks_time07:38:502
259940,0migration/214626-21kthreadcore07:58:542
259940,0migration/210651-21munin-node09:43:472
259940,0migration/210637-21kthreadcore08:38:552
259940,0migration/210637-21kthreadcore08:38:552
249940,0watchdog/26004-21sshd09:20:322
249940,0watchdog/228734-21perl09:53:522
249940,0watchdog/214442-21grep10:58:562
195129943,0cyclictest5602-21awk11:13:592
195129943,0cyclictest3571-21lldpd12:03:502
195129943,0cyclictest3524-21snmpd08:51:252
195129943,0cyclictest3524-21snmpd08:46:252
195129943,0cyclictest3524-21snmpd08:33:552
195129943,0cyclictest3394-21awk10:53:542
195129943,0cyclictest3250-21irqbalance09:08:532
195129943,0cyclictest3250-21irqbalance08:26:232
195129943,0cyclictest3250-21irqbalance08:18:432
195129943,0cyclictest3250-21irqbalance08:14:032
195129943,0cyclictest3250-21irqbalance07:29:532
195129943,0cyclictest3250-21irqbalance07:24:432
195129943,0cyclictest28617-21awk08:53:522
195129943,0cyclictest10630-21awk09:03:522
195129941,0cyclictest0-21swapper/212:43:492
195119944,0cyclictest0-21swapper/112:23:481
195119944,0cyclictest0-21swapper/112:00:381
195119943,0cyclictest6727-21awk07:53:531
195119943,0cyclictest3571-21lldpd12:18:201
195119943,0cyclictest3571-21lldpd11:56:501
195119943,0cyclictest3571-21lldpd09:59:491
195119943,0cyclictest3524-21snmpd11:49:271
195119943,0cyclictest3524-21snmpd10:39:261
195119943,0cyclictest3524-21snmpd08:36:251
195119943,0cyclictest3524-21snmpd08:06:251
195119943,0cyclictest3524-21snmpd07:39:251
195119943,0cyclictest3502-21awk08:58:531
195119943,0cyclictest3290-21awk10:53:531
195119943,0cyclictest3250-21irqbalance12:03:441
195119943,0cyclictest3250-21irqbalance10:34:241
195119943,0cyclictest3250-21irqbalance10:14:241
195119943,0cyclictest3250-21irqbalance10:08:441
195119943,0cyclictest3250-21irqbalance10:05:441
195119943,0cyclictest3250-21irqbalance08:53:431
195119943,0cyclictest3250-21irqbalance08:09:431
195119943,0cyclictest31798-21awk12:43:521
195109944,0cyclictest722-21kworker/0:008:03:380
195109944,0cyclictest722-21kworker/0:007:58:480
195109944,0cyclictest722-21kworker/0:007:45:200
195109944,0cyclictest11526-21kworker/0:107:23:420
195109944,0cyclictest1039-21kworker/0:109:14:380
195109944,0cyclictest1039-21kworker/0:108:53:400
195109944,0cyclictest1039-21kworker/0:108:48:440
195109944,0cyclictest1039-21kworker/0:108:34:460
195109944,0cyclictest1039-21kworker/0:108:20:180
195109944,0cyclictest1039-21kworker/0:108:13:440
195109944,0cyclictest0-21swapper/011:08:370
195109943,0cyclictest722-21kworker/0:007:28:500
179940,0migration/18178-21timerandwakeup07:29:001
179940,0migration/17954-21kthreadcore08:38:541
179940,0migration/17954-21kthreadcore08:38:541
179940,0migration/17474-21idleruntime10:18:511
179940,0migration/1676-21kthreadcore07:48:531
179940,0migration/132598-21munin-node09:18:531
179940,0migration/130417-21kthreadcore09:33:531
179940,0migration/129942-21kthreadcore07:23:551
179940,0migration/128005-21sensors_fan11:23:591
179940,0migration/123727-21latency_hist08:28:371
179940,0migration/115775-21smart_sda09:03:591
179940,0migration/113340-21latency_hist12:33:381
179940,0migration/113218-21df_abs07:58:491
169940,0watchdog/126567-21ssh09:50:441
169940,0watchdog/12293-21cpuspeed_turbos08:13:481
169940,0watchdog/118458-21if_eth010:43:521
169940,0watchdog/117917-21munin-node09:08:521
169940,0watchdog/116365-21if_err_eth011:38:521
169940,0watchdog/110875-21diskmemload12:13:371
169940,0watchdog/10-21swapper/110:58:561
169940,0watchdog/10-21swapper/109:53:561
329930,0watchdog/30-21swapper/309:13:483
329930,0watchdog/30-21swapper/308:43:563
329930,0watchdog/30-21swapper/307:54:083
29815030,0irq/29-eth0-tx-0-21swapper/212:13:502
29805030,0irq/28-eth0-rx-0-21swapper/308:58:503
29805030,0irq/28-eth0-rx-0-21swapper/308:33:493
29805030,0irq/28-eth0-rx-0-21swapper/307:43:483
29805030,0irq/28-eth0-rx-0-21swapper/307:33:483
29805030,0irq/28-eth0-rx-0-21swapper/307:18:473
195129932,0cyclictest3250-21irqbalance08:28:432
195129932,0cyclictest24958-21idleruntime09:13:512
195129932,0cyclictest21187-21awk08:03:512
195129932,0cyclictest15257-21sensors07:33:582
195119932,0cyclictest5880-21awk12:28:511
195119932,0cyclictest3524-21snmpd08:43:551
195119932,0cyclictest3250-21irqbalance12:38:441
195119932,0cyclictest30157-21sensors09:13:581
195119932,0cyclictest24576-21awk07:43:521
195119932,0cyclictest19939-21cpu07:18:481
179930,0migration/12997-21kthreadcore11:28:551
169930,0watchdog/10-21swapper/109:28:521
169920,0watchdog/10-21swapper/107:33:401
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional