You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-01 - 19:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Thu Jan 01, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2898624434,0sleep30-21swapper/307:09:133
2910523930,0sleep20-21swapper/207:10:322
2908023625,0sleep10-21swapper/107:10:191
2886722824,0sleep00-21swapper/007:07:460
292689976,0cyclictest23690-21ps07:51:550
339960,0migration/37468-21sh10:37:413
339960,0migration/35572-21unixbench-2d09:42:063
339960,0migration/332396-21sh10:36:243
339960,0migration/331124-21sshd12:05:203
339960,0migration/327210-21sh10:12:133
339960,0migration/324944-21sh12:18:483
339960,0migration/320841-21munin-node11:41:573
339960,0migration/315855-21runrttasks12:13:203
339960,0migration/311996-21sh11:52:223
29805060,0irq/28-eth0-rx-2631-21grep11:11:583
292699960,0cyclictest0-21swapper/112:30:121
292689960,0cyclictest0-21swapper/009:41:370
4150,0ktimersoftd/00-21swapper/011:29:270
339950,0migration/39211-21kthreadcore08:46:593
339950,0migration/38215-21cpu09:46:503
339950,0migration/37457-21kthreadcore11:31:583
339950,0migration/35306-21munin-node07:16:533
339950,0migration/33906-21fschecks_time12:26:533
339950,0migration/33860-21munin-node09:26:523
339950,0migration/33502-21kthreadcore09:06:563
339950,0migration/32872-21latency07:11:573
339950,0migration/326100-21kthreadcore07:51:563
339950,0migration/322971-21kthreadcore10:46:593
339950,0migration/321007-21aten_r1power_en12:36:523
339950,0migration/319863-21if_eth007:26:553
339950,0migration/315105-21taskset08:29:403
339950,0migration/314130-21munin-node11:56:513
339950,0migration/313526-21kthreadcore09:11:573
339950,0migration/313115-21sh11:36:583
339950,0migration/313064-21aten_r1power_vo09:31:533
339950,0migration/312156-21fschecks_count07:21:523
339950,0migration/310365-21gltestperf10:41:543
329950,0watchdog/35584-21basename08:01:543
329950,0watchdog/331620-21grep12:21:593
329950,0watchdog/3298050irq/28-eth0-rx-10:08:463
329950,0watchdog/324929-21tr08:56:583
329950,0watchdog/30-21swapper/310:56:503
29815050,0irq/29-eth0-tx-8874-21cut10:22:002
29815050,0irq/29-eth0-tx-7190-21users10:37:062
29815050,0irq/29-eth0-tx-29919-21munin-node08:41:550
29815050,0irq/29-eth0-tx-29481-21munin-node07:12:050
29815050,0irq/29-eth0-tx-27504-21kthreadcore09:56:572
29815050,0irq/29-eth0-tx-26710-21ssh09:21:442
29815050,0irq/29-eth0-tx-23791-21ssh12:17:022
29815050,0irq/29-eth0-tx-23496-21timerandwakeup09:52:072
29815050,0irq/29-eth0-tx-20991-21ssh11:05:252
29815050,0irq/29-eth0-tx-16235-21munin-node11:22:032
29815050,0irq/29-eth0-tx-1275-21munin-node09:06:490
29815050,0irq/29-eth0-tx-0-21swapper/212:37:042
29815050,0irq/29-eth0-tx-0-21swapper/212:12:002
29815050,0irq/29-eth0-tx-0-21swapper/211:49:222
29815050,0irq/29-eth0-tx-0-21swapper/209:39:102
29815050,0irq/29-eth0-tx-0-21swapper/009:11:500
29805050,0irq/28-eth0-rx-8182-21fschecks_time11:16:533
29805050,0irq/28-eth0-rx-3817-21sed07:57:023
29805050,0irq/28-eth0-rx-32401-21df_inode12:06:533
29805050,0irq/28-eth0-rx-29681-21if_eth111:46:563
29805050,0irq/28-eth0-rx-28831-21ssh09:37:083
29805050,0irq/28-eth0-rx-25969-21fschecks_time11:26:543
29805050,0irq/28-eth0-rx-25489-21kthreadcore11:06:583
29805050,0irq/28-eth0-rx-16334-21irqrtprio10:26:573
29805050,0irq/28-eth0-rx-14655-21tr12:31:593
29805050,0irq/28-eth0-rx-0-21swapper/311:24:303
29805050,0irq/28-eth0-rx-0-21swapper/311:05:403
29805050,0irq/28-eth0-rx-0-21swapper/310:53:593
29805050,0irq/28-eth0-rx-0-21swapper/310:26:173
29805050,0irq/28-eth0-rx-0-21swapper/310:03:023
29805050,0irq/28-eth0-rx-0-21swapper/309:57:103
29805050,0irq/28-eth0-rx-0-21swapper/309:55:043
29805050,0irq/28-eth0-rx-0-21swapper/309:21:573
29805050,0irq/28-eth0-rx-0-21swapper/309:16:553
292719955,0cyclictest0-21swapper/211:52:262
292719955,0cyclictest0-21swapper/210:11:502
292719955,0cyclictest0-21swapper/209:35:352
292719950,0cyclictest0-21swapper/211:21:322
292719950,0cyclictest0-21swapper/210:49:412
292699955,0cyclictest8394-21diskmemload09:42:371
292699955,0cyclictest0-21swapper/112:07:491
292699955,0cyclictest0-21swapper/111:36:171
292699955,0cyclictest0-21swapper/109:32:131
292699955,0cyclictest0-21swapper/109:15:111
292699950,0cyclictest0-21swapper/110:51:021
292689955,0cyclictest0-21swapper/012:27:100
292689955,0cyclictest0-21swapper/012:18:290
292689955,0cyclictest0-21swapper/012:09:490
292689955,0cyclictest0-21swapper/011:57:310
292689955,0cyclictest0-21swapper/010:06:220
292689955,0cyclictest0-21swapper/009:50:080
292689954,0cyclictest27977-21awk09:21:550
292689954,0cyclictest16500-21sed07:46:550
292689950,0cyclictest0-21swapper/011:46:390
292689950,0cyclictest0-21swapper/011:20:280
292689950,0cyclictest0-21swapper/010:48:370
292689950,0cyclictest0-21swapper/010:30:390
27150,0ktimersoftd/20-21swapper/211:29:272
259950,0migration/28580-21missed_timers10:02:012
259950,0migration/25576-21latency12:07:002
259950,0migration/25355-21fschecks_count08:46:532
259950,0migration/231374-21sh10:33:572
259950,0migration/225849-21kthreadcore11:06:582
259950,0migration/225422-21kthreadcore07:51:562
259950,0migration/220791-21unixbench_singl11:57:072
259950,0migration/220082-21fschecks_time08:56:532
259950,0migration/215051-21timerandwakeup09:12:042
259950,0migration/21407-21kthreadcore11:11:582
259950,0migration/210079-21munin-node10:57:012
249950,0watchdog/29178-21kthreadcore09:26:582
249950,0watchdog/28394-21diskmemload10:51:542
249950,0watchdog/27342-21cut11:31:582
249950,0watchdog/216284-21fschecks_time08:31:542
19150,0ktimersoftd/10-21swapper/112:37:271
19150,0ktimersoftd/10-21swapper/111:12:191
179950,0migration/1327-21sendmail_mailtr12:22:031
179950,0migration/130259-21kthreadcore11:46:581
179950,0migration/118735-21munin-node12:16:561
179950,0migration/116211-21gltestperf07:46:521
179950,0migration/112572-21taskset09:31:391
169950,0watchdog/15487-21cpuspeed_turbos11:51:541
169950,0watchdog/13168-21ssh09:26:261
169950,0watchdog/117562-21grep11:56:581
149950,0migration/031833-21missed_timers07:32:020
149950,0migration/031644-21kthreadcore08:16:570
149950,0migration/031612-21kthreadcore09:01:590
149950,0migration/02878-21runrttasks10:55:060
149950,0migration/028393-21latency_hist11:46:390
149950,0migration/026431-21kthreadcore08:36:590
149950,0migration/024378-21sh11:25:260
149950,0migration/023688-21latency_hist10:31:400
149950,0migration/021191-21kthreadcore08:11:560
149950,0migration/019496-21latency_hist11:41:390
149950,0migration/019489-21munin-node08:56:510
149950,0migration/019132-21latency_hist08:56:390
149950,0migration/018918-21kthreadcore09:51:580
149950,0migration/018210-21kthreadcore09:32:000
149950,0migration/017613-21latency08:06:580
149950,0migration/016504-21hwlatdetect08:31:550
149950,0migration/011879-21taskset09:30:140
8305040,0irq/26-0000:00:0-21swapper/212:26:592
8305040,0irq/26-0000:00:0-21swapper/207:46:592
339940,0migration/39465-21irqcore07:41:543
339940,0migration/33901-21diskmemload10:17:313
339940,0migration/319937-21kthreadcore07:46:563
329940,0watchdog/316159-21fschecks_time08:31:543
329940,0watchdog/30-21swapper/309:01:583
329940,0watchdog/30-21swapper/308:09:503
29815040,0irq/29-eth0-tx-30720-21kthreadcore12:21:582
29815040,0irq/29-eth0-tx-19701-21kthreadcore09:16:552
29815040,0irq/29-eth0-tx-19688-21munin-node11:41:542
29815040,0irq/29-eth0-tx-0-21swapper/212:01:412
29815040,0irq/29-eth0-tx-0-21swapper/210:41:412
29815040,0irq/29-eth0-tx-0-21swapper/007:36:510
29815040,0irq/29-eth0-tx-0-21swapper/007:26:530
29805040,0irq/28-eth0-rx-0-21swapper/308:51:513
29805040,0irq/28-eth0-rx-0-21swapper/308:36:523
29805040,0irq/28-eth0-rx-0-21swapper/308:21:513
292719943,0cyclictest3571-21lldpd08:00:292
292719943,0cyclictest3524-21snmpd08:22:182
292719943,0cyclictest30546-21awk07:11:542
292719943,0cyclictest30473-21awk10:16:552
292719943,0cyclictest2414-21awk09:06:542
292719943,0cyclictest13066-21awk12:31:562
292719943,0cyclictest12622-21awk07:21:542
292719943,0cyclictest12582-21awk10:06:542
292699944,0cyclictest0-21swapper/111:24:181
292699943,0cyclictest9711-21awk12:11:571
292699943,0cyclictest3571-21lldpd10:44:311
292699943,0cyclictest3571-21lldpd09:57:011
292699943,0cyclictest3571-21lldpd09:53:001
292699943,0cyclictest3524-21snmpd11:20:201
292699943,0cyclictest30813-21awk07:56:521
292699943,0cyclictest21545-21awk10:11:551
292699943,0cyclictest13174-21awk08:51:561
292699943,0cyclictest12964-21awk08:06:541
292699940,0cyclictest0-21swapper/112:04:141
292689944,0cyclictest0-21swapper/011:04:230
292689943,0cyclictest6256-21awk11:51:580
292689943,0cyclictest3571-21lldpd10:39:010
292689943,0cyclictest3571-21lldpd08:03:290
292689943,0cyclictest3250-21irqbalance12:37:260
292689943,0cyclictest3250-21irqbalance12:32:060
292689943,0cyclictest3250-21irqbalance10:24:160
292689943,0cyclictest3250-21irqbalance09:45:350
292689943,0cyclictest27077-21awk09:56:550
292689943,0cyclictest21488-21awk10:11:540
292689943,0cyclictest12599-21awk10:06:540
259940,0migration/28882-21kthreadcore07:16:572
259940,0migration/23860-21kthreadcore07:36:572
259940,0migration/229998-21kthreadcore07:32:002
259940,0migration/222527-21kthreadcore07:26:572
259940,0migration/215493-21kthreadcore11:36:592
259940,0migration/214945-21aten_r1power_cu10:26:512
259940,0migration/213079-21irqcore08:06:552
259940,0migration/212942-21munin-node08:51:542
249940,0watchdog/27940-21ssh09:46:422
249940,0watchdog/24575-21cut08:01:502
249940,0watchdog/23266-21tr09:41:582
249940,0watchdog/225220-21python08:12:022
249940,0watchdog/210576-21kthreadcore08:26:582
179940,0migration/19699-21irqcore08:26:571
179940,0migration/129744-21cpuspeed_turbos07:11:511
179940,0migration/126016-21kthreadcore11:06:581
179940,0migration/125069-21kthreadcore07:51:561
179940,0migration/124984-21sh09:18:301
179940,0migration/124161-21df_abs10:31:531
179940,0migration/118903-21taskset10:08:441
179940,0migration/11862-21fschecks_time08:21:511
179940,0migration/11433-21fschecks_time07:36:531
179940,0migration/113718-21fschecks_time11:01:551
179940,0migration/112661-21if_eth007:21:541
179940,0migration/110748-21kthreadcore07:41:561
179940,0migration/110173-21kthreadcore10:22:011
169940,0watchdog/18934-21cut10:56:581
169940,0watchdog/16413-21kthreadcore08:46:581
169940,0watchdog/128084-21fschecks_time10:51:541
169940,0watchdog/124928-21cut08:56:581
169940,0watchdog/123413-21perl08:36:541
169940,0watchdog/120490-21runrttasks12:36:191
169940,0watchdog/115102-21ssh09:47:581
169940,0watchdog/11497-21if_eth010:36:541
169940,0watchdog/10-21swapper/111:36:581
169940,0watchdog/10-21swapper/111:26:461
169940,0watchdog/10-21swapper/110:01:581
169940,0watchdog/10-21swapper/109:02:021
169940,0watchdog/10-21swapper/108:01:501
169940,0watchdog/10-21swapper/107:26:581
149940,0migration/08506-21cpu08:26:520
149940,0migration/05650-21fschecks_time08:46:530
149940,0migration/04571-21pmu-power11:12:010
149940,0migration/0410-21kthreadcore10:16:570
149940,0migration/031292-21kthreadcore12:21:580
149940,0migration/024286-21iostat12:01:580
149940,0migration/014580-21kthreadcore07:21:560
149940,0migration/013038-21kthreadcore12:12:000
329930,0watchdog/30-21swapper/307:36:583
29815030,0irq/29-eth0-tx-0-21swapper/008:21:490
29805030,0irq/28-eth0-rx-0-21swapper/308:44:043
29805030,0irq/28-eth0-rx-0-21swapper/308:16:503
29805030,0irq/28-eth0-rx-0-21swapper/308:11:503
29805030,0irq/28-eth0-rx-0-21swapper/307:32:023
292719932,0cyclictest32440-21sensors08:17:032
292719932,0cyclictest23844-21awk08:36:562
292699933,0cyclictest20745-21awk11:41:561
292699932,0cyclictest30574-21awk10:16:551
292699932,0cyclictest16065-21awk10:26:561
292699930,0cyclictest5202-21perl07:16:521
292689932,0cyclictest9216-21awk07:41:540
292689932,0cyclictest5942-21kthreadcore07:16:560
292689932,0cyclictest3571-21lldpd09:20:310
292689932,0cyclictest30719-21awk07:56:510
292689932,0cyclictest17080-21sh10:44:220
292689932,0cyclictest10302-21sensors10:57:030
249930,0watchdog/20-21swapper/209:01:582
179930,0migration/131634-21kthreadcore08:16:571
179930,0migration/12106-21kthreadcore08:41:571
169930,0watchdog/10-21swapper/109:36:581
169930,0watchdog/10-21swapper/109:06:541
169930,0watchdog/10-21swapper/108:31:541
169930,0watchdog/10-21swapper/108:12:021
292719920,0cyclictest8080-21runrttasks07:41:442
292699921,0cyclictest25728-21latency_hist07:31:391
292689921,0cyclictest0-21swapper/011:31:510
292689920,0cyclictest0-21swapper/011:06:470
249920,0watchdog/20-21swapper/208:41:462
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional