You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 07:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7.osadl.org (updated Sat Jul 27, 2024 00:44:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
69252990,4chrt12352-21diskmemload22:42:553
69252990,4chrt12352-21diskmemload22:42:553
512899973,64cyclictest18764-21/usr/sbin/munin23:56:482
145302930,4chrt14529-21ssh22:02:070
512899923,61cyclictest23354-21apt-get23:11:432
5139999025,55cyclictest7241-21apt-get00:31:443
248522900,9sleep0161rcuc/021:26:330
5128998850,13cyclictest141rcu_preempt20:01:332
5128998850,13cyclictest141rcu_preempt20:01:332
5139998733,38cyclictest12352-21diskmemload21:07:013
5116998770,11cyclictest26980-21munin-plugin-st20:11:300
57462850,8sleep30-21swapper/323:35:023
5128998359,16cyclictest4257-21munin-plugin-st20:41:302
37862819,31sleep20-21swapper/219:01:562
512899803,53cyclictest20445-21ssh21:18:052
512899803,53cyclictest20445-21ssh21:18:052
512899792,50cyclictest30307-21runrttasks21:35:222
512899792,50cyclictest30307-21runrttasks21:35:222
5139997840,30cyclictest41-21ksoftirqd/319:16:533
5139997840,30cyclictest41-21ksoftirqd/319:16:533
512899785,45cyclictest0-21swapper/222:21:062
359727811,41sleep33598-21munin-node19:01:403
5139997737,8cyclictest141rcu_preempt23:17:363
494027711,37sleep14974-21munin-run19:06:301
5139997648,19cyclictest7522-21latency_hist20:51:323
5128997657,12cyclictest7716-21unixbench_singl23:37:052
5128997657,12cyclictest7716-21unixbench_singl23:37:052
512899763,66cyclictest23180-21grep21:22:252
512899752,48cyclictest10975-21ssh22:50:472
5139997438,16cyclictest141rcu_preempt21:13:353
512899743,42cyclictest21502-21users19:52:112
511699742,42cyclictest4536-21timerwakeupswit23:32:030
5116997410,39cyclictest12-21ksoftirqd/000:17:060
284822740,7sleep10-21swapper/121:31:551
284822740,7sleep10-21swapper/121:31:551
5128997355,11cyclictest20755-21/usr/sbin/munin23:06:452
512899733,59cyclictest29197-21fschecks_time22:26:512
512899733,53cyclictest416-21snmpd22:37:152
512899732,62cyclictest17694-21timerwakeupswit22:07:032
512899732,62cyclictest11511-21rm22:51:352
5123997351,13cyclictest14769-21cstates22:56:471
5123997350,13cyclictest9433-21fschecks_time19:16:521
5123997350,13cyclictest9433-21fschecks_time19:16:521
5139997254,10cyclictest5106-21cyclictest20:36:313
5139997224,24cyclictest141rcu_preempt19:12:093
512899723,62cyclictest31246-21ssh23:22:362
5128997229,34cyclictest0-21swapper/221:41:312
5139997121,28cyclictest141rcu_preempt21:02:083
5139997121,28cyclictest141rcu_preempt21:02:083
512899719,56cyclictest0-21swapper/200:07:072
512899713,59cyclictest31081-21uname00:16:532
512899712,60cyclictest6113-21/usr/sbin/munin22:41:582
512899712,60cyclictest6113-21/usr/sbin/munin22:41:582
512899712,60cyclictest16658-21latency_hist22:06:332
512899711,44cyclictest8967-21ssh00:34:252
5139997035,10cyclictest141rcu_preempt22:11:523
5139997030,12cyclictest141rcu_preempt19:52:063
512899704,56cyclictest11264-21fschecks_time21:01:532
512899704,56cyclictest11264-21fschecks_time21:01:532
512899703,59cyclictest9851-21df_inode23:41:482
512899703,59cyclictest5510-21ssh00:27:522
512899703,58cyclictest1596-21unixbench_multi23:27:092
512899703,42cyclictest0-21swapper/222:13:182
5123997053,11cyclictest26247-21unixbench_singl21:27:301
5123997048,14cyclictest4356-21idleruntime-cro21:46:301
5123997045,17cyclictest8357-21taskset00:32:361
5123997032,9cyclictest141rcu_preempt22:36:541
5116997033,15cyclictest141rcu_preempt20:26:490
5139996952,10cyclictest29890-21unixbench_multi22:27:053
5139996948,8cyclictest141rcu_preempt23:02:373
5139996928,19cyclictest141rcu_preempt19:06:553
5139996910,26cyclictest41-21ksoftirqd/323:51:583
5128996952,10cyclictest183-21pr/ttyS022:23:542
512899694,57cyclictest19279-21latency19:46:542
5128996928,34cyclictest12352-21diskmemload21:51:462
512899692,61cyclictest0-21swapper/223:03:152
512899692,59cyclictest5915-21ssh21:47:302
5116996936,24cyclictest17317-21cut23:01:320
5116996925,23cyclictest141rcu_preempt22:24:580
5116996910,20cyclictest12-21ksoftirqd/023:02:540
5139996830,14cyclictest141rcu_preempt20:21:523
5128996849,13cyclictest362-21in:imuxsock21:16:302
512899684,58cyclictest2153-21kworker/u8:423:51:302
512899683,57cyclictest10116-21cat20:57:052
512899683,36cyclictest925-21ssh22:33:072
5128996831,27cyclictest0-21swapper/200:21:502
5128996831,27cyclictest0-21swapper/200:21:502
512899681,45cyclictest24008-21ssh00:05:222
5116996841,13cyclictest141rcu_preempt23:15:120
513999676,14cyclictest12632-21unixbench_singl22:52:093
5139996741,16cyclictest27399-21munin-plugin-st00:11:293
5139996733,12cyclictest141rcu_preempt22:10:083
5139996733,12cyclictest141rcu_preempt00:26:323
5139996733,12cyclictest141rcu_preempt00:26:323
5139996729,19cyclictest363-21in:imklog23:08:323
512899675,55cyclictest0-21swapper/223:17:222
5128996749,11cyclictest25404-21cut21:27:052
512899673,56cyclictest1611-21/usr/sbin/munin21:41:452
512899673,56cyclictest12538-21systemd-journal23:56:292
512899673,51cyclictest27239-21apt-get20:11:422
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional