You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 13:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot2.osadl.org (updated Sat Apr 27, 2024 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3057624936,0sleep00-21swapper/018:52:250
3062323927,0sleep20-21swapper/218:53:032
3056323725,0sleep10-21swapper/118:52:221
3038323626,0sleep30-21swapper/318:50:163
308299977,0cyclictest2546-21nvme23:11:100
308299977,0cyclictest2546-21nvme20:03:230
308299976,0cyclictest8158-21grep00:19:560
339960,0migration/39691-21sh21:34:403
339960,0migration/36869-21unixbench_multi22:25:073
339960,0migration/3392-21sh21:29:143
339960,0migration/328698-21irqcore19:14:543
339960,0migration/326579-21sh21:43:433
339960,0migration/315166-21sh21:18:423
339960,0migration/314693-21kthreadcore19:04:563
308319960,0cyclictest9847-21diskmemload23:38:042
308319960,0cyclictest0-21swapper/219:05:002
308309960,0cyclictest0-21swapper/123:20:411
308309960,0cyclictest0-21swapper/122:50:151
308299966,0cyclictest9847-21diskmemload21:02:040
308299966,0cyclictest2546-21nvme23:02:050
308299966,0cyclictest2546-21nvme22:00:590
308299966,0cyclictest2546-21nvme21:58:120
308299966,0cyclictest2546-21nvme21:35:560
308299966,0cyclictest2546-21nvme21:23:410
308299966,0cyclictest2546-21nvme20:27:550
308299960,0cyclictest0-21swapper/022:05:080
29935060,0irq/33-eth0-tx-13355-21gltestperf21:54:512
29925060,0irq/32-eth0-rx-27876-21fschecks_time21:44:503
149960,0migration/06338-21munin-node18:59:480
149960,0migration/011528-21kthreadcore20:29:560
149960,0migration/011160-21unixbench_singl00:00:010
8315050,0irq/26-0000:00:17235-21python23:45:032
339950,0migration/38928-21kthreadcore22:09:543
339950,0migration/36463-21fschecks_count18:59:483
339950,0migration/35633-21taskset19:42:443
339950,0migration/35072-21kthreadcore19:19:553
339950,0migration/331143-21kthreadcore19:59:543
339950,0migration/330934-21kthreadcore22:39:593
339950,0migration/330547-21diskmemload22:20:103
339950,0migration/329606-21kthreadcore19:34:553
339950,0migration/326250-21kthreadcore23:14:533
339950,0migration/325785-21munin-node23:34:463
339950,0migration/31995-21kthreadcore21:09:553
339950,0migration/31445-21kthreadcore22:59:573
339950,0migration/313398-21kthreadcore20:54:573
339950,0migration/313037-21taskset20:31:073
339950,0migration/311047-21munin-node00:00:013
329950,0watchdog/39182-21ssh21:33:563
329950,0watchdog/324252-21sh23:31:323
329950,0watchdog/321274-21port_sshpriv22:15:003
329950,0watchdog/319518-21aten_r1power_cu23:49:443
329950,0watchdog/317682-21fschecks_count20:14:493
329950,0watchdog/315629-21cut23:09:563
329950,0watchdog/30-21swapper/319:54:533
308319954,0cyclictest23871-21snmpd22:01:262
308319950,0cyclictest0-21swapper/220:57:062
308309955,0cyclictest0-21swapper/122:34:481
308309955,0cyclictest0-21swapper/122:05:101
308309955,0cyclictest0-21swapper/121:13:371
308309950,0cyclictest0-21swapper/123:37:521
308309950,0cyclictest0-21swapper/122:44:441
308309950,0cyclictest0-21swapper/122:43:381
308309950,0cyclictest0-21swapper/122:14:281
308309950,0cyclictest0-21swapper/121:39:191
308309950,0cyclictest0-21swapper/119:10:011
308299955,0cyclictest2546-21nvme20:41:090
308299955,0cyclictest2546-21nvme19:20:340
308299955,0cyclictest0-21swapper/021:14:120
308299954,0cyclictest4048-21awk22:44:530
308299950,0cyclictest0-21swapper/023:17:110
308299950,0cyclictest0-21swapper/021:47:000
29935050,0irq/33-eth0-tx-878-21munin-node21:29:502
29935050,0irq/33-eth0-tx-6201-21ssh21:13:102
29935050,0irq/33-eth0-tx-3948-21ssh22:05:032
29935050,0irq/33-eth0-tx-21855-21munin-node21:04:502
29935050,0irq/33-eth0-tx-168512sleep221:36:072
29935050,0irq/33-eth0-tx-16238-21ssh22:31:252
29935050,0irq/33-eth0-tx-0-21swapper/223:52:212
29935050,0irq/33-eth0-tx-0-21swapper/222:47:242
29935050,0irq/33-eth0-tx-0-21swapper/222:23:152
29935050,0irq/33-eth0-tx-0-21swapper/221:40:312
29935050,0irq/33-eth0-tx-0-21swapper/221:27:052
29935050,0irq/33-eth0-tx-0-21swapper/200:02:202
29935050,0irq/33-eth0-tx-0-21swapper/020:54:410
29935050,0irq/33-eth0-tx-0-21swapper/020:38:250
29935050,0irq/33-eth0-tx-0-21swapper/019:39:030
29925050,0irq/32-eth0-rx-7369-21if_eth1.300:19:533
29925050,0irq/32-eth0-rx-5154-21kthreadcore20:49:583
29925050,0irq/32-eth0-rx-32016-21smartctl18:54:533
29925050,0irq/32-eth0-rx-29445-21irqcore23:54:523
29925050,0irq/32-eth0-rx-22958-21python19:30:013
29925050,0irq/32-eth0-rx-21207-21entropy20:39:503
29925050,0irq/32-eth0-rx-18980-21iostat_ios22:34:553
29925050,0irq/32-eth0-rx-15877-21ssh22:30:283
29925050,0irq/32-eth0-rx-13226-21sort21:54:513
29925050,0irq/32-eth0-rx-0-21swapper/323:45:253
29925050,0irq/32-eth0-rx-0-21swapper/323:42:003
29925050,0irq/32-eth0-rx-0-21swapper/323:24:573
29925050,0irq/32-eth0-rx-0-21swapper/323:20:493
29925050,0irq/32-eth0-rx-0-21swapper/323:06:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional