You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 18:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Fri Dec 12, 2025 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1939724737,0sleep10-21swapper/118:14:281
1945424635,0sleep20-21swapper/218:15:052
1971923622,0sleep00-21swapper/018:18:110
1959322824,0sleep30-21swapper/318:16:423
198339988,0cyclictest2546-21nvme19:52:280
329970,0watchdog/319576-21sh21:05:143
29925070,0irq/32-eth0-rx-18266-21perl23:18:593
198339976,0cyclictest12695-21ssh22:37:510
339960,0migration/34149-21kthreadcore18:29:023
339960,0migration/328409-21sh21:11:033
339960,0migration/325959-21sh20:49:293
339960,0migration/31616-21timerandwakeup19:54:103
329960,0watchdog/36386-21runrttasks21:38:103
329960,0watchdog/34877-21ntpq19:34:063
329960,0watchdog/34439-21python22:49:063
329960,0watchdog/3299250irq/32-eth0-rx-21:46:383
329960,0watchdog/32489-21ssh23:47:143
329960,0watchdog/30-21swapper/323:24:063
329960,0watchdog/30-21swapper/320:03:583
29925060,0irq/32-eth0-rx-29529-21kthreadcore23:04:033
29925060,0irq/32-eth0-rx-13868-21sensors21:39:093
29925060,0irq/32-eth0-rx-0-21swapper/323:40:373
29925060,0irq/32-eth0-rx-0-21swapper/323:02:513
29925060,0irq/32-eth0-rx-0-21swapper/322:57:213
29925060,0irq/32-eth0-rx-0-21swapper/322:45:423
29925060,0irq/32-eth0-rx-0-21swapper/322:42:013
29925060,0irq/32-eth0-rx-0-21swapper/322:35:503
29925060,0irq/32-eth0-rx-0-21swapper/322:30:183
29925060,0irq/32-eth0-rx-0-21swapper/322:12:083
29925060,0irq/32-eth0-rx-0-21swapper/322:05:183
29925060,0irq/32-eth0-rx-0-21swapper/321:58:593
29925060,0irq/32-eth0-rx-0-21swapper/321:54:263
29925060,0irq/32-eth0-rx-0-21swapper/321:51:133
29925060,0irq/32-eth0-rx-0-21swapper/321:32:343
29925060,0irq/32-eth0-rx-0-21swapper/321:23:583
29925060,0irq/32-eth0-rx-0-21swapper/320:29:323
29925060,0irq/32-eth0-rx-0-21swapper/320:20:433
198359966,0cyclictest2546-21nvme23:44:012
198359966,0cyclictest2546-21nvme23:43:032
198359966,0cyclictest2546-21nvme23:36:382
198359966,0cyclictest2546-21nvme23:36:382
198359966,0cyclictest2546-21nvme23:32:322
198359966,0cyclictest2546-21nvme23:15:432
198359966,0cyclictest2546-21nvme23:12:402
198359966,0cyclictest2546-21nvme23:04:542
198359966,0cyclictest2546-21nvme22:55:372
198359966,0cyclictest2546-21nvme22:52:042
198359966,0cyclictest2546-21nvme22:45:272
198359966,0cyclictest2546-21nvme22:39:032
198359966,0cyclictest2546-21nvme22:34:372
198359966,0cyclictest2546-21nvme22:31:382
198359966,0cyclictest2546-21nvme22:24:332
198359966,0cyclictest2546-21nvme22:19:252
198359966,0cyclictest2546-21nvme22:15:222
198359966,0cyclictest2546-21nvme21:52:302
198359966,0cyclictest2546-21nvme21:47:522
198359966,0cyclictest2546-21nvme21:43:072
198359966,0cyclictest2546-21nvme21:35:252
198359966,0cyclictest2546-21nvme21:29:062
198359966,0cyclictest2546-21nvme20:55:492
198359966,0cyclictest2546-21nvme20:44:082
198359966,0cyclictest2546-21nvme20:32:332
198359966,0cyclictest2546-21nvme20:24:392
198359966,0cyclictest2546-21nvme19:34:092
198359966,0cyclictest2546-21nvme18:23:582
198339960,0cyclictest0-21swapper/023:19:090
198339960,0cyclictest0-21swapper/022:16:050
339950,0migration/34964-21kthreadcore23:09:023
339950,0migration/330761-21taskset20:14:463
339950,0migration/328482-21idleruntime19:08:563
339950,0migration/326666-21kthreadcore19:29:013
339950,0migration/322503-21kthreadcore19:04:003
339950,0migration/320841-21fschecks_time18:18:573
329950,0watchdog/328144-21diskstats20:53:583
329950,0watchdog/322009-21irqrtprio19:48:583
329950,0watchdog/318952-21cat18:59:023
329950,0watchdog/317678-21grep20:08:583
329950,0watchdog/313849-21cut22:19:023
329950,0watchdog/30-21swapper/321:15:343
329950,0watchdog/30-21swapper/320:02:303
329950,0watchdog/30-21swapper/319:38:543
329950,0watchdog/30-21swapper/318:23:543
29935050,0irq/33-eth0-tx-7614-21latency20:39:022
29935050,0irq/33-eth0-tx-3921-21munin-node20:59:002
29935050,0irq/33-eth0-tx-31370-21munin-node20:19:050
29935050,0irq/33-eth0-tx-0-21swapper/223:03:062
29935050,0irq/33-eth0-tx-0-21swapper/221:06:342
29935050,0irq/33-eth0-tx-0-21swapper/018:55:080
29935050,0irq/33-eth0-tx-0-21swapper/018:33:560
29935050,0irq/33-eth0-tx-0-21swapper/018:29:090
29925050,0irq/32-eth0-rx-4356-21ssh20:58:593
29925050,0irq/32-eth0-rx-14938-21kthreadcore19:44:033
29925050,0irq/32-eth0-rx-12505-21kthreadcore20:43:573
29925050,0irq/32-eth0-rx-0-21swapper/323:34:103
29925050,0irq/32-eth0-rx-0-21swapper/323:34:103
29925050,0irq/32-eth0-rx-0-21swapper/323:29:313
29925050,0irq/32-eth0-rx-0-21swapper/323:13:553
29925050,0irq/32-eth0-rx-0-21swapper/322:23:483
29925050,0irq/32-eth0-rx-0-21swapper/322:18:383
29925050,0irq/32-eth0-rx-0-21swapper/321:20:353
29925050,0irq/32-eth0-rx-0-21swapper/320:38:543
29925050,0irq/32-eth0-rx-0-21swapper/320:33:503
29925050,0irq/32-eth0-rx-0-21swapper/320:25:363
29925050,0irq/32-eth0-rx-0-21swapper/318:48:503
259950,0migration/224108-21munin-node22:04:052
198359955,0cyclictest2546-21nvme23:18:472
198359955,0cyclictest2546-21nvme22:01:252
198359955,0cyclictest2546-21nvme20:22:112
198359955,0cyclictest2546-21nvme20:18:392
198359955,0cyclictest2546-21nvme20:09:152
198359955,0cyclictest2546-21nvme19:55:382
198359955,0cyclictest2546-21nvme19:49:122
198359955,0cyclictest2546-21nvme19:28:502
198359955,0cyclictest2546-21nvme19:28:392
198359955,0cyclictest2546-21nvme19:20:292
198359955,0cyclictest2546-21nvme19:13:312
198359955,0cyclictest2546-21nvme19:05:382
198359955,0cyclictest2546-21nvme18:59:412
198359955,0cyclictest2546-21nvme18:56:042
198359955,0cyclictest2546-21nvme18:51:592
198359955,0cyclictest2546-21nvme18:44:562
198359955,0cyclictest2546-21nvme18:40:022
198349950,0cyclictest0-21swapper/122:30:101
198349950,0cyclictest0-21swapper/120:34:361
198349950,0cyclictest0-21swapper/120:31:361
198339955,0cyclictest0-21swapper/023:15:030
198339955,0cyclictest0-21swapper/022:11:020
198339951,0cyclictest2287-21munin-node19:13:570
198339951,0cyclictest18007-21ssh20:46:340
198339950,0cyclictest0-21swapper/023:13:000
198339950,0cyclictest0-21swapper/022:46:590
198339950,0cyclictest0-21swapper/020:36:270
179950,0migration/14885-21switchtime18:49:081
179950,0migration/13590-21kthreadcore20:39:001
179950,0migration/126575-21kthreadcore23:04:021
179950,0migration/122212-21kthreadcore22:04:021
179950,0migration/12161-21taskset19:57:441
179950,0migration/121090-21aten_r1power_en21:08:541
169950,0watchdog/19972-21ssh23:33:301
169950,0watchdog/18402-21ssh21:56:421
169950,0watchdog/15793-21ssh22:52:061
169950,0watchdog/124371-21ssh23:20:141
169950,0watchdog/124088-21cut18:43:541
169950,0watchdog/10-21swapper/120:49:221
169950,0watchdog/10-21swapper/120:08:581
169950,0watchdog/10-21swapper/119:47:101
169950,0watchdog/10-21swapper/119:14:221
149950,0migration/07223-21kthreadcore20:39:020
149950,0migration/06695-21latency21:54:000
149950,0migration/028717-21cpuspeed_turbos22:28:580
149950,0migration/026084-21latency19:04:010
149950,0migration/022847-21kthreadcore22:04:020
149950,0migration/02191-21kthreadcore21:34:000
149950,0migration/016611-21kthreadcore21:24:020
149950,0migration/015284-21kthreadcore21:59:040
149950,0migration/015212-21kthreadcore22:19:020
149950,0migration/012883-21kthreadcore19:19:000
149950,0migration/012225-21kthreadcore21:39:040
149950,0migration/011045-21fschecks_time23:33:590
149950,0migration/011045-21fschecks_time23:33:590
149950,0migration/010780-21kthreadcore19:39:010
149950,0migration/01058-21kthreadcore22:49:000
4140,0ktimersoftd/00-21swapper/018:40:530
329940,0watchdog/33351-21if_err_eth019:13:583
329940,0watchdog/30-21swapper/319:23:543
329940,0watchdog/30-21swapper/318:55:383
329940,0watchdog/30-21swapper/318:43:543
29935040,0irq/33-eth0-tx-7867-21ssh21:55:112
29935040,0irq/33-eth0-tx-0-21swapper/221:23:492
29935040,0irq/33-eth0-tx-0-21swapper/020:13:590
29935040,0irq/33-eth0-tx-0-21swapper/019:43:570
29935040,0irq/33-eth0-tx-0-21swapper/019:29:000
29935040,0irq/33-eth0-tx-0-21swapper/018:19:040
29925040,0irq/32-eth0-rx-0-21swapper/319:20:213
29925040,0irq/32-eth0-rx-0-21swapper/318:33:563
259940,0migration/231418-21kthreadcore21:14:052
259940,0migration/225699-21latency_hist23:23:422
259940,0migration/225049-21kthreadcore21:09:012
259940,0migration/214255-21kthreadcore18:34:002
249940,0watchdog/27128-21kthreadcore19:59:022
249940,0watchdog/20-21swapper/220:49:022
249940,0watchdog/20-21swapper/220:04:022
198359943,0cyclictest6946-21awk21:18:582
198359943,0cyclictest3599-21lldpd19:15:382
198359943,0cyclictest3230-21awk18:29:002
198359943,0cyclictest27775-21awk22:09:022
198359943,0cyclictest23871-21snmpd20:33:512
198359943,0cyclictest23871-21snmpd19:44:062
198349944,0cyclictest0-21swapper/122:09:501
198349944,0cyclictest0-21swapper/121:43:581
198349943,0cyclictest5876-21awk22:34:011
198349943,0cyclictest3599-21lldpd22:45:421
198349943,0cyclictest3599-21lldpd22:17:371
198349943,0cyclictest3599-21lldpd21:18:511
198349943,0cyclictest3599-21lldpd21:18:211
198349943,0cyclictest3599-21lldpd19:52:391
198349943,0cyclictest3262-21irqbalance20:13:461
198349943,0cyclictest3262-21irqbalance19:29:261
198349943,0cyclictest3262-21irqbalance19:18:461
198349943,0cyclictest3262-21irqbalance19:08:461
198349943,0cyclictest3262-21irqbalance19:06:461
198349943,0cyclictest32494-21awk20:18:591
198349943,0cyclictest28462-21awk23:44:031
198349943,0cyclictest23900-21awk21:28:581
198349943,0cyclictest17846-21awk19:23:581
198349943,0cyclictest10008-21awk23:14:001
198349940,0cyclictest0-21swapper/121:26:191
198339944,0cyclictest31802-21kworker/0:018:49:470
198339944,0cyclictest31111-21diskmemload21:31:190
198339944,0cyclictest0-21swapper/021:50:230
198339943,0cyclictest5481-21sadc21:18:410
198339943,0cyclictest4979-21awk20:59:010
198339943,0cyclictest32329-21awk19:34:020
198339943,0cyclictest26978-21awk23:24:010
198339943,0cyclictest22146-21awk21:08:580
198339943,0cyclictest20008-21awk23:39:010
198339943,0cyclictest17588-21awk20:29:010
198339942,0cyclictest28146-21idleruntime-cro22:28:410
198339942,0cyclictest24130-21tr23:03:570
198339942,0cyclictest24055-21grep18:43:540
198339942,0cyclictest20746-21ssh21:08:410
198339942,0cyclictest17200-21tr20:08:570
198339942,0cyclictest14224-21ssh20:24:100
198339942,0cyclictest13792-21sh22:38:550
198339942,0cyclictest11596-21sh21:19:010
198339942,0cyclictest10987-21grep20:03:590
198339941,0cyclictest28032-21tune2fs23:43:590
198339940,0cyclictest2491-21munin-node19:58:580
198339940,0cyclictest0-21swapper/018:58:510
179940,0migration/19218-21kthreadcore20:59:041
179940,0migration/18255-21fschecks_count20:23:571
179940,0migration/14533-21kthreadcore23:09:021
179940,0migration/132072-21sendmail_mailst23:24:071
179940,0migration/127840-21aten_r1power_po20:53:571
179940,0migration/114694-21kthreadcore23:34:041
179940,0migration/114694-21kthreadcore23:34:041
179940,0migration/114672-21kthreadcore21:04:041
179940,0migration/113517-21fschecks_count18:58:571
179940,0migration/111984-21kthreadcore20:43:571
179940,0migration/111177-21kthreadcore18:54:001
169940,0watchdog/19609-21cpu21:58:581
169940,0watchdog/17139-21kthreadcore18:29:021
169940,0watchdog/127388-21aten_r1power_vo18:23:541
169940,0watchdog/120963-21ssh22:42:021
169940,0watchdog/116800-21cpu18:38:541
169940,0watchdog/114983-21ssh21:41:261
169940,0watchdog/111404-21kthreadcore22:54:021
169940,0watchdog/10-21swapper/123:38:581
169940,0watchdog/10-21swapper/122:25:461
169940,0watchdog/10-21swapper/122:19:021
169940,0watchdog/10-21swapper/121:49:541
169940,0watchdog/10-21swapper/121:33:421
169940,0watchdog/10-21swapper/120:03:541
169940,0watchdog/10-21swapper/119:59:021
169940,0watchdog/10-21swapper/119:38:541
169940,0watchdog/10-21swapper/118:18:541
149940,0migration/023990-21sh21:47:560
149940,0migration/015649-21df_abs22:58:550
329930,0watchdog/30-21swapper/318:38:543
249930,0watchdog/20-21swapper/219:38:542
198359933,0cyclictest3599-21lldpd18:19:372
198349932,0cyclictest3262-21irqbalance19:33:461
198349932,0cyclictest15911-21unixbench_singl18:34:081
198339933,0cyclictest31802-21kworker/0:019:23:530
198339932,0cyclictest1650-21sort23:28:420
198339931,0cyclictest41ktimersoftd/022:53:420
198339931,0cyclictest27638-21cat19:53:410
198339931,0cyclictest27580-21ls20:53:410
198339931,0cyclictest27556-21basename19:08:530
198339931,0cyclictest27535-21tr18:23:550
198339931,0cyclictest190152chrt20:48:460
169930,0watchdog/10-21swapper/122:58:501
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional