You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 08:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot8.osadl.org (updated Sat Apr 27, 2024 00:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
133499845748,76cyclictest0-21swapper/020:35:000
133599835731,76cyclictest32054-21munin-run20:35:001
892277024,30sleep00-21swapper/019:06:510
327292691670,14sleep10-21swapper/119:05:221
133599487417,40cyclictest0-21swapper/119:10:531
133499482410,43cyclictest0-21swapper/019:10:540
114692780,5sleep111468-21hwlatdetect23:00:181
1334997325,42cyclictest88450irq/46-eth0-tx-22:40:240
1334997313,54cyclictest14740-21ssh00:01:460
133499724,62cyclictest0-21swapper/021:17:370
1334997211,37cyclictest14002-21latency_hist19:45:020
133499712,6cyclictest7137-21grep21:55:280
1334997024,30cyclictest88450irq/46-eth0-tx-00:05:140
133499702,10cyclictest10833-21munin-run23:00:010
1334997011,54cyclictest2947-21ssh00:37:460
133599699,53cyclictest0-21swapper/123:56:321
133499693,51cyclictest31858-21ssh23:35:240
133499692,8cyclictest26313-21ssh23:25:290
133499692,60cyclictest26969-21kworker/0:221:35:270
1334996913,50cyclictest17412-21latency_hist22:15:000
1334996911,45cyclictest12408-21diskmemload21:25:010
133499689,52cyclictest0-21swapper/023:30:230
1334996820,33cyclictest88450irq/46-eth0-tx-23:20:550
133499682,8cyclictest14330-21ssh22:09:360
133499682,7cyclictest8726-21latency_hist19:30:010
133499682,7cyclictest4752-21ssh23:45:130
133499682,7cyclictest25043-21aten2.4-expect20:15:090
133499682,60cyclictest24832-21runrttasks21:30:250
133599679,53cyclictest0-21swapper/122:47:381
133599674,56cyclictest5245-21netstat23:45:221
1335996712,50cyclictest16079-21sh22:11:041
133499679,38cyclictest12894-21latency_hist00:00:000
133499677,53cyclictest21844-21aten_r1power_vo00:15:100
133499674,58cyclictest3620-21pgrep23:42:490
133499673,42cyclictest30307-21ssh22:35:490
133499672,9cyclictest18599-21ssh22:15:290
133499672,9cyclictest1134-21ssh21:45:290
133499672,8cyclictest26217-21ssh00:21:440
133499672,51cyclictest15790-21ssh23:07:330
133499672,10cyclictest7981-21latency_hist22:55:000
1334996713,48cyclictest21379-21munin-node20:05:100
1334996712,50cyclictest25847-21ssh22:29:500
133599667,53cyclictest0-21swapper/100:15:151
133599666,54cyclictest0-21swapper/122:43:151
133599664,55cyclictest20927-21latency_hist21:25:011
133599663,7cyclictest31845-21sh21:43:151
133599662,7cyclictest12702-21munin-node22:05:291
133499668,52cyclictest11317-21ssh22:04:100
133499667,52cyclictest18811-21ssh00:10:070
133499663,10cyclictest8782-21munin-run21:00:010
133499662,6cyclictest12408-21diskmemload22:33:360
133499662,58cyclictest7810-21hwlatdetect23:50:170
133499662,57cyclictest21527-21ssh23:17:360
133499662,57cyclictest21527-21ssh23:17:350
133499662,57cyclictest11635-21munin-node23:00:210
133499662,10cyclictest21816-21ssh21:25:220
1334996610,50cyclictest88450irq/46-eth0-tx-23:14:120
133499661,50cyclictest3834-21missed_timers21:50:240
133599659,50cyclictest24442-21unixbench_singl22:25:301
133599656,54cyclictest0-21swapper/121:31:471
133599656,54cyclictest0-21swapper/100:34:161
133599653,8cyclictest22611-21aten_r1power_po23:20:131
133599652,7cyclictest5377-21munin-node19:20:121
1335996518,37cyclictest0-21swapper/121:10:271
133499657,52cyclictest28859-21ssh00:25:590
133499653,8cyclictest31845-21ssh21:43:150
133499652,9cyclictest10596-21idleruntime-cro21:05:000
133499652,7cyclictest1336-21munin-node20:00:100
133499652,57cyclictest10812-21kworker/0:221:10:280
1334996514,43cyclictest26790-21munin-node20:20:120
133599644,53cyclictest9336-21unixbench_multi22:55:331
133599643,8cyclictest9755-21timerwakeupswit19:30:271
133599643,8cyclictest8928-21munin-node21:00:081
1335996420,38cyclictest5844-21ssh22:50:201
133599642,55cyclictest5288-21cat20:50:021
1335996415,44cyclictest17851-21gltestperf22:15:141
1335996413,46cyclictest20797-21sh00:12:471
1335996411,48cyclictest88350irq/45-eth0-rx-00:29:191
133499645,53cyclictest0-21swapper/021:05:240
1334996422,36cyclictest88450irq/46-eth0-tx-00:31:270
133499642,54cyclictest21366-21ssh22:20:260
133599636,52cyclictest0-21swapper/123:30:371
133599636,50cyclictest0-21swapper/121:05:321
133599636,49cyclictest26421-21df_inode22:30:151
133599633,9cyclictest12606-21munin-node19:40:151
133599633,8cyclictest88350irq/45-eth0-rx-21:48:381
133599633,8cyclictest15822-21munin-node21:15:161
133599632,9cyclictest7583-21sh23:50:141
1334996322,35cyclictest88450irq/46-eth0-tx-19:31:350
133499632,54cyclictest3652-21ssh22:45:320
133499631,46cyclictest18350-21latency19:55:220
133599626,50cyclictest0-21swapper/122:01:021
133599626,50cyclictest0-21swapper/119:45:161
133599625,7cyclictest29435-21munin-node22:35:181
133599625,53cyclictest0-21swapper/122:24:121
133599625,52cyclictest0-21swapper/121:26:391
133599625,40cyclictest0-21swapper/123:25:031
133599625,10cyclictest466-21munin-node20:35:241
133599624,8cyclictest2055-21munin-node23:40:181
133599624,8cyclictest0-21swapper/121:35:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional