You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 12:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Wed Dec 10, 2025 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3007923726,0sleep00-21swapper/018:15:470
2997823725,0sleep10-21swapper/118:14:361
3024923127,0sleep30-21swapper/318:17:473
3025822925,0sleep20-21swapper/218:17:542
329970,0watchdog/313043-21df18:29:023
329970,0watchdog/30-21swapper/321:04:093
29925070,0irq/32-eth0-rx-11331-21tr22:09:073
29925070,0irq/32-eth0-rx-0-21swapper/323:11:343
29925070,0irq/32-eth0-rx-0-21swapper/321:34:093
339960,0migration/37070-21sh23:03:333
339960,0migration/36979-21sh20:54:003
339960,0migration/33149-21munin-node22:24:053
339960,0migration/326172-21sh23:32:123
339960,0migration/323381-21sh18:58:493
339960,0migration/322554-21sh21:58:063
339960,0migration/311353-21sh20:35:343
329960,0watchdog/36546-21perl19:09:063
329960,0watchdog/36179-21unixbench_multi22:04:173
329960,0watchdog/30-21swapper/321:50:093
329960,0watchdog/30-21swapper/320:30:213
329960,0watchdog/30-21swapper/320:23:013
304269960,0cyclictest0-21swapper/222:29:062
304269960,0cyclictest0-21swapper/221:06:292
29935060,0irq/33-eth0-tx-0-21swapper/019:42:590
29925060,0irq/32-eth0-rx-6667-21munin-node18:24:073
29925060,0irq/32-eth0-rx-26943-21sh22:19:083
29925060,0irq/32-eth0-rx-15342-21memory21:14:093
29925060,0irq/32-eth0-rx-12226-21diskstats23:44:033
29925060,0irq/32-eth0-rx-10296-21munin-node23:24:023
29925060,0irq/32-eth0-rx-0-21swapper/323:40:073
29925060,0irq/32-eth0-rx-0-21swapper/323:37:433
29925060,0irq/32-eth0-rx-0-21swapper/323:19:183
29925060,0irq/32-eth0-rx-0-21swapper/322:55:083
29925060,0irq/32-eth0-rx-0-21swapper/322:51:593
29925060,0irq/32-eth0-rx-0-21swapper/322:46:163
29925060,0irq/32-eth0-rx-0-21swapper/322:42:223
29925060,0irq/32-eth0-rx-0-21swapper/322:36:133
29925060,0irq/32-eth0-rx-0-21swapper/322:29:453
29925060,0irq/32-eth0-rx-0-21swapper/322:17:553
29925060,0irq/32-eth0-rx-0-21swapper/321:46:123
29925060,0irq/32-eth0-rx-0-21swapper/321:40:103
29925060,0irq/32-eth0-rx-0-21swapper/321:24:043
29925060,0irq/32-eth0-rx-0-21swapper/320:49:523
339950,0migration/328278-21kthreadcore19:44:063
339950,0migration/324413-21missed_timers20:24:103
339950,0migration/322455-21fschecks_count20:44:043
339950,0migration/32152-21kthreadcore19:49:083
339950,0migration/317645-21munin-node19:39:033
339950,0migration/315725-21unixbench_singl18:49:143
339950,0migration/311352-21kthreadcore19:34:093
329950,0watchdog/320439-21munin-node20:04:093
329950,0watchdog/315338-21grep19:59:093
329950,0watchdog/30-21swapper/318:19:383
304269955,0cyclictest9503-21diskmemload23:15:082
304269955,0cyclictest0-21swapper/221:26:402
304269955,0cyclictest0-21swapper/220:20:552
304269950,0cyclictest0-21swapper/223:46:592
304269950,0cyclictest0-21swapper/223:01:442
304269950,0cyclictest0-21swapper/220:48:592
304129955,0cyclictest0-21swapper/022:56:060
304129955,0cyclictest0-21swapper/021:22:460
304129955,0cyclictest0-21swapper/018:34:050
304129950,0cyclictest0-21swapper/022:03:460
304129950,0cyclictest0-21swapper/020:36:540
29935050,0irq/33-eth0-tx-6912-21munin-node20:54:052
29935050,0irq/33-eth0-tx-5993-21munin-node19:54:070
29935050,0irq/33-eth0-tx-29146-21perl22:39:032
29935050,0irq/33-eth0-tx-22258-21munin-node22:54:142
29935050,0irq/33-eth0-tx-18073-21munin-node21:19:052
29935050,0irq/33-eth0-tx-0-21swapper/222:12:462
29935050,0irq/33-eth0-tx-0-21swapper/221:34:272
29925050,0irq/32-eth0-rx-4107-21cut21:09:083
29925050,0irq/32-eth0-rx-2831-21sed20:14:023
29925050,0irq/32-eth0-rx-24277-21if_eth1.221:59:053
29925050,0irq/32-eth0-rx-0-21swapper/323:14:143
29925050,0irq/32-eth0-rx-0-21swapper/323:05:293
29925050,0irq/32-eth0-rx-0-21swapper/321:28:533
29925050,0irq/32-eth0-rx-0-21swapper/321:18:563
29925050,0irq/32-eth0-rx-0-21swapper/320:59:453
29925050,0irq/32-eth0-rx-0-21swapper/320:39:213
29925050,0irq/32-eth0-rx-0-21swapper/318:39:013
27150,0ktimersoftd/20-21swapper/220:38:092
259950,0migration/229440-21munin-node21:44:042
259950,0migration/223832-21sh22:14:332
259950,0migration/222868-21idleruntime20:44:062
259950,0migration/222755-21munin-node19:39:092
259950,0migration/211362-21sh21:33:212
259950,0migration/211265-21munin-node22:44:152
249950,0watchdog/20-21swapper/218:34:022
179950,0migration/17175-21idleruntime-cro23:03:481
179950,0migration/16092-21fschecks_count18:24:051
179950,0migration/129385-21kthreadcore18:39:071
179950,0migration/129213-21kthreadcore21:04:091
179950,0migration/125523-21latency_hist22:18:481
169950,0watchdog/14696-21ssh21:47:171
169950,0watchdog/126976-21ssh23:33:531
169950,0watchdog/120258-21tr18:34:021
149950,0migration/09548-21kthreadcore20:54:070
149950,0migration/08831-21irqcore23:04:080
149950,0migration/05454-21sh22:59:240
149950,0migration/03193-21aten_r1power_cu23:39:000
149950,0migration/030698-21munin-node18:19:010
149950,0migration/030027-21kthreadcore21:04:090
149950,0migration/028354-21gltestperf19:24:080
149950,0migration/028092-21munin-node20:29:030
149950,0migration/027292-21runrttasks22:36:510
149950,0migration/027148-21kthreadcore20:44:090
149950,0migration/021724-21kthreadcore23:29:080
149950,0migration/021449-21kthreadcore23:09:070
149950,0migration/021274-21fschecks_time21:39:050
149950,0migration/021058-21kthreadcore22:14:070
149950,0migration/018808-21kthreadcore19:59:100
149950,0migration/018138-21kthreadcore21:54:070
149950,0migration/017329-21gltestperf18:54:040
149950,0migration/014846-21kthreadcore21:34:090
149950,0migration/014733-21kthreadcore19:34:100
149950,0migration/014543-21kthreadcore18:49:060
149950,0migration/012236-21taskset22:46:130
339940,0migration/3568-21kthreadcore19:04:063
339940,0migration/310792-21kthreadcore19:54:093
329940,0watchdog/30-21swapper/319:19:103
329940,0watchdog/30-21swapper/319:16:503
329940,0watchdog/30-21swapper/318:34:023
304269943,0cyclictest9506-21sadc20:18:482
304269943,0cyclictest3599-21lldpd21:54:052
304269943,0cyclictest3599-21lldpd21:10:042
304269943,0cyclictest3599-21lldpd18:27:022
304269943,0cyclictest3262-21irqbalance19:59:032
304269943,0cyclictest3262-21irqbalance19:48:532
304269943,0cyclictest3262-21irqbalance19:47:132
304269943,0cyclictest31772-21awk18:19:062
304269943,0cyclictest24176-21awk21:59:042
304269943,0cyclictest23871-21snmpd21:49:312
304269943,0cyclictest23871-21snmpd19:00:012
304269943,0cyclictest10867-21awk23:24:042
304269941,0cyclictest0-21swapper/222:04:032
304229943,0cyclictest6690-21awk21:49:041
304229943,0cyclictest3599-21lldpd21:20:341
304229943,0cyclictest3599-21lldpd19:19:021
304229943,0cyclictest3262-21irqbalance22:44:131
304229943,0cyclictest3262-21irqbalance22:40:031
304229943,0cyclictest3262-21irqbalance21:59:031
304229943,0cyclictest3262-21irqbalance19:06:331
304229943,0cyclictest3262-21irqbalance18:54:231
304229943,0cyclictest3262-21irqbalance18:49:241
304229943,0cyclictest3262-21irqbalance18:44:141
304229943,0cyclictest3262-21irqbalance18:23:341
304229943,0cyclictest31728-21awk20:49:041
304229943,0cyclictest28432-21awk19:24:091
304229943,0cyclictest27856-21awk21:24:041
304229943,0cyclictest26790-21awk22:19:071
304229943,0cyclictest23871-21snmpd22:25:161
304229943,0cyclictest23871-21snmpd19:48:011
304229943,0cyclictest23408-21awk22:54:051
304229943,0cyclictest20796-21awk22:34:061
304229943,0cyclictest14003-21awk19:14:061
304229943,0cyclictest12939-21awk21:34:071
304229943,0cyclictest10963-21awk20:19:071
304129944,0cyclictest0-21swapper/021:47:030
304129943,0cyclictest452-21awk22:04:060
304129943,0cyclictest3599-21lldpd19:29:020
304129943,0cyclictest3599-21lldpd18:44:020
304129943,0cyclictest3262-21irqbalance23:45:030
304129943,0cyclictest3262-21irqbalance22:38:530
304129943,0cyclictest3262-21irqbalance22:31:230
304129943,0cyclictest3262-21irqbalance21:49:030
304129943,0cyclictest24984-21awk19:44:040
304129943,0cyclictest2178-21awk23:19:060
304129943,0cyclictest19541-21awk20:24:060
304129943,0cyclictest1683-21awk21:09:060
304129940,0cyclictest27121-21munin-node18:39:020
29935040,0irq/33-eth0-tx-9309-21ssh21:13:532
29935040,0irq/33-eth0-tx-8947-21ssh23:22:202
29935040,0irq/33-eth0-tx-3246-21ssh23:39:002
29935040,0irq/33-eth0-tx-21184-21kthreadcore23:29:082
29935040,0irq/33-eth0-tx-20797-21if_eth1.222:34:062
29935040,0irq/33-eth0-tx-19751-21ssh20:39:272
29935040,0irq/33-eth0-tx-0-21swapper/222:20:152
29935040,0irq/33-eth0-tx-0-21swapper/221:01:572
29935040,0irq/33-eth0-tx-0-21swapper/220:28:502
29935040,0irq/33-eth0-tx-0-21swapper/220:23:502
29935040,0irq/33-eth0-tx-0-21swapper/020:18:570
29935040,0irq/33-eth0-tx-0-21swapper/019:14:110
29935040,0irq/33-eth0-tx-0-21swapper/019:09:100
29925040,0irq/32-eth0-rx-0-21swapper/320:13:043
29925040,0irq/32-eth0-rx-0-21swapper/319:29:033
259940,0migration/29415-21latency_hist19:33:492
259940,0migration/2928-21munin-node18:39:132
259940,0migration/28248-21kthreadcore19:09:092
259940,0migration/232094-21irqcore19:04:062
259940,0migration/229384-21kthreadcore23:34:082
259940,0migration/22416-21df_abs22:24:022
259940,0migration/222783-21kthreadcore20:04:092
259940,0migration/217056-21kthreadcore22:49:082
259940,0migration/211881-21kthreadcore23:04:102
249940,0watchdog/29843-21fschecks_time18:49:022
249940,0watchdog/224265-21kthreadcore21:39:092
249940,0watchdog/220561-21entropy19:19:062
249940,0watchdog/20-21swapper/223:08:572
249940,0watchdog/20-21swapper/219:29:022
249940,0watchdog/20-21swapper/218:29:022
179940,0migration/17931-21kthreadcore19:54:081
179940,0migration/17394-21latency_hist23:03:491
179940,0migration/16605-21kthreadcore23:39:071
179940,0migration/132326-21irqcore19:49:071
179940,0migration/131664-21kthreadcore20:09:081
179940,0migration/127157-21kthreadcore23:14:111
179940,0migration/126952-21kthreadcore20:44:091
179940,0migration/123551-21latency_hist18:58:491
179940,0migration/120973-21unixbench-2d21:54:151
179940,0migration/120503-21kthreadcore23:29:081
179940,0migration/114301-21kthreadcore19:34:101
179940,0migration/113782-21fschecks_time20:39:031
179940,0migration/112448-21kthreadcore23:24:061
179940,0migration/11164-21munin-node23:19:021
169940,0watchdog/16724-21ssh22:05:291
169940,0watchdog/14215-21if_eth021:29:051
169940,0watchdog/124264-21cut21:39:091
169940,0watchdog/120331-21ssh22:49:331
169940,0watchdog/118943-21ssh23:45:491
169940,0watchdog/116687-21munin-node19:39:021
169940,0watchdog/116555-21ssh21:15:291
169940,0watchdog/10-21swapper/123:13:211
169940,0watchdog/10-21swapper/122:29:091
169940,0watchdog/10-21swapper/122:12:411
169940,0watchdog/10-21swapper/121:10:451
169940,0watchdog/10-21swapper/120:34:051
169940,0watchdog/10-21swapper/120:29:371
169940,0watchdog/10-21swapper/120:04:051
169940,0watchdog/10-21swapper/119:31:221
169940,0watchdog/10-21swapper/119:09:061
169940,0watchdog/10-21swapper/118:31:581
149940,0migration/0926-21sh23:34:120
149940,0migration/09217-21runrttasks22:25:040
149940,0migration/09215-21gltestperf22:09:040
149940,0migration/06085-21fschecks_count18:24:050
149940,0migration/04366-21kthreadcore19:49:080
149940,0migration/032291-21kthreadcore20:09:090
149940,0migration/030329-21kthreadcore21:24:060
149940,0migration/026251-21fschecks_count22:19:050
149940,0migration/019113-21kthreadcore22:49:080
149940,0migration/018921-21missed_timers20:39:090
149940,0migration/018838-21munin-node18:29:100
149940,0migration/015735-21aten_r1power_po20:59:010
8315030,0irq/26-0000:00:0-21swapper/220:09:092
329930,0watchdog/30-21swapper/319:23:503
304269932,0cyclictest3599-21lldpd18:46:022
304269932,0cyclictest3262-21irqbalance19:53:532
304269932,0cyclictest17594-21awk18:54:062
304269932,0cyclictest13236-21tr19:14:032
304269930,0cyclictest29919-21kthreadcore19:24:112
304229932,0cyclictest4100-21kthreadcore20:14:071
304229932,0cyclictest23977-21kthreadcore20:24:091
304129933,0cyclictest0-21swapper/021:15:410
304129932,0cyclictest31536-21tune2fs19:04:030
304129932,0cyclictest30652-21hostname20:49:000
304129932,0cyclictest2775-21grep20:14:020
304129932,0cyclictest26003-21if_eth023:14:090
304129932,0cyclictest10915-21awk23:24:040
304129931,0cyclictest0-21swapper/019:19:040
304129930,0cyclictest6019-21grep21:29:070
304129930,0cyclictest0-21swapper/020:04:030
29935030,0irq/33-eth0-tx-0-21swapper/018:59:060
29925030,0irq/32-eth0-rx-0-21swapper/318:59:023
29925030,0irq/32-eth0-rx-0-21swapper/318:46:243
169930,0watchdog/10-21swapper/120:59:011
169930,0watchdog/10-21swapper/120:54:051
169930,0watchdog/10-21swapper/119:58:571
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional