You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-15 - 22:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot2.osadl.org (updated Sat Jun 15, 2024 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1022499122122,0cyclictest4620-21sensors11:32:091
1022599107106,0cyclictest16589-21awk08:47:012
10224995151,0cyclictest23871-21snmpd10:04:431
10225994949,0cyclictest83150irq/26-0000:00:08:32:312
10225994848,0cyclictest83150irq/26-0000:00:09:21:572
990023926,0sleep10-21swapper/106:48:391
979123926,0sleep20-21swapper/206:47:202
982823828,0sleep30-21swapper/306:47:493
987923127,0sleep00-21swapper/006:48:220
8315060,0irq/26-0000:00:6807-21crond07:11:353
29935060,0irq/33-eth0-tx-7644-21munin-node07:56:580
29935060,0irq/33-eth0-tx-1478-21munin-node09:56:542
29935060,0irq/33-eth0-tx-0-21swapper/210:54:072
29925060,0irq/32-eth0-rx-6870-21iostat_ios11:17:013
29925060,0irq/32-eth0-rx-4447-21aten_r1power_vo10:56:583
29925060,0irq/32-eth0-rx-32450-21sshd07:51:313
102249960,0cyclictest0-21swapper/110:16:501
8315050,0irq/26-0000:00:4061-21munin-run08:16:352
339950,0migration/39327-21fschecks_count09:41:533
339950,0migration/37870-21kthreadcore10:37:023
339950,0migration/37790-21fschecks_time07:11:523
339950,0migration/36561-21latency_hist11:36:353
339950,0migration/34000-21kthreadcore09:37:023
339950,0migration/332178-21taskset09:35:243
339950,0migration/332020-21kthreadcore10:12:063
339950,0migration/330563-21aten_r1power_cu11:31:473
339950,0migration/330376-21runrttasks08:55:183
339950,0migration/329542-21kthreadcore10:32:003
339950,0migration/327782-21sh10:50:583
339950,0migration/32745-21kthreadcore07:52:013
339950,0migration/32699-21irqcore12:11:563
339950,0migration/320931-21kthreadcore09:07:023
339950,0migration/320813-21taskset11:22:293
339950,0migration/318727-21kthreadcore07:17:003
339950,0migration/317698-21aten_r1power_cu06:56:483
339950,0migration/317581-21taskset07:37:293
339950,0migration/317521-21diskmemload12:20:073
339950,0migration/314914-21sshd11:57:213
339950,0migration/313994-21kthreadcore10:41:593
339950,0migration/313041-21kthreadcore10:22:013
339950,0migration/311376-21kthreadcore09:21:573
329950,0watchdog/37384-21diskstats09:01:483
329950,0watchdog/3644-21grep11:11:593
329950,0watchdog/36386-21runrttasks11:49:193
329950,0watchdog/327612-21munin-node11:07:113
329950,0watchdog/313228-21kthreadcore10:02:003
329950,0watchdog/312022-21munin-node08:21:483
29935050,0irq/33-eth0-tx-7787-21perl09:01:492
29935050,0irq/33-eth0-tx-22703-21munin-node12:02:012
29935050,0irq/33-eth0-tx-18469-21ssh10:42:352
29935050,0irq/33-eth0-tx-17183-21ssh12:19:082
29935050,0irq/33-eth0-tx-14507-21kthreadcore10:02:002
29935050,0irq/33-eth0-tx-13930-21munin-node11:21:492
29935050,0irq/33-eth0-tx-0-21swapper/210:20:152
29935050,0irq/33-eth0-tx-0-21swapper/209:31:462
29935050,0irq/33-eth0-tx-0-21swapper/007:17:160
29925050,0irq/32-eth0-rx-6977-21ssh11:54:043
29925050,0irq/32-eth0-rx-5506-21munin-node09:17:013
29925050,0irq/32-eth0-rx-30044-21grep08:32:003
29925050,0irq/32-eth0-rx-26255-21if_eth012:06:553
29925050,0irq/32-eth0-rx-23118-21ssh11:46:243
29925050,0irq/32-eth0-rx-21928-21kthreadcore10:07:023
29925050,0irq/32-eth0-rx-20445-21if_eth010:26:563
29925050,0irq/32-eth0-rx-1831-21kthreadcore08:57:043
29925050,0irq/32-eth0-rx-1040-21cpu08:36:513
29925050,0irq/32-eth0-rx-0-21swapper/311:02:003
29925050,0irq/32-eth0-rx-0-21swapper/310:51:473
29925050,0irq/32-eth0-rx-0-21swapper/309:52:313
29925050,0irq/32-eth0-rx-0-21swapper/309:27:033
29925050,0irq/32-eth0-rx-0-21swapper/307:41:483
259950,0migration/26772-21munin-node09:37:072
259950,0migration/24260-21kthreadcore12:11:572
259950,0migration/229719-21munin-node07:26:512
259950,0migration/228542-21kthreadcore09:51:552
259950,0migration/226027-21kthreadcore09:12:012
259950,0migration/222230-21kthreadcore10:47:002
259950,0migration/218537-21taskset08:26:162
259950,0migration/217826-21kthreadcore07:17:002
259950,0migration/213153-21timerandwakeup11:37:092
249950,0watchdog/26315-21iceccd11:56:552
249950,0watchdog/229932-21kthreadcore12:06:592
249950,0watchdog/213420-21kthreadcore06:52:002
19150,0ktimersoftd/10-21swapper/111:14:421
19150,0ktimersoftd/10-21swapper/108:27:061
179950,0migration/16642-21kthreadcore09:56:591
179950,0migration/132099-21kthreadcore08:12:001
179950,0migration/125839-21sh09:31:561
179950,0migration/117948-21kthreadcore11:21:551
179950,0migration/117569-21kthreadcore08:02:051
179950,0migration/116047-21hwlatdetect11:41:551
179950,0migration/115796-21kthreadcore10:22:021
169950,0watchdog/11964-21users10:32:161
149950,0migration/08893-21kthreadcore10:57:080
149950,0migration/06406-21latency_hist11:36:350
149950,0migration/0633-21hwlatdetect07:06:540
149950,0migration/029130-21taskset08:52:110
149950,0migration/028502-21cpuspeed_turbos10:51:500
149950,0migration/027817-21timerwakeupswit11:07:150
149950,0migration/023056-21sh11:46:120
149950,0migration/021816-21unixbench_multi09:07:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional