You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-27 - 02:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7 (updated Mon Feb 26, 2024 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1284211017,57sleep31288-21cron07:09:053
1284211017,57sleep31288-21cron07:09:053
1449991072,66cyclictest0-21swapper/007:19:300
413821040,4chrt4139-21sshd08:51:391
14499910118,52cyclictest31795-21munin-node11:39:220
1449991003,68cyclictest399-21runrttasks09:58:250
1449991003,62cyclictest0-21swapper/009:12:040
1449991003,62cyclictest0-21swapper/009:12:040
1449991002,80cyclictest399-21runrttasks11:14:150
144999992,62cyclictest0-21swapper/011:19:370
46362970,4chrt4628-21apt-get08:54:323
1449999632,56cyclictest14799-21unixbench_multi11:09:500
1449999632,56cyclictest14799-21unixbench_multi11:09:500
144999952,63cyclictest25423-21latency_hist08:19:080
144999943,60cyclictest2659-21/usr/sbin/munin10:49:400
144999942,71cyclictest24574-21ssh09:34:410
144999942,71cyclictest24574-21ssh09:34:410
144999933,80cyclictest20605-21fschecks_count08:04:350
144999933,80cyclictest20605-21fschecks_count08:04:350
144999933,68cyclictest29454-21latency_hist09:44:080
144999932,63cyclictest11758-21idleruntime-cro07:39:050
9892926,13sleep00-21swapper/007:05:160
9892926,13sleep00-21swapper/007:05:160
1449999219,57cyclictest9229-21diskmemload12:34:310
1449999210,57cyclictest9229-21diskmemload09:28:450
1449999210,57cyclictest9229-21diskmemload09:28:450
144999912,71cyclictest9229-21diskmemload11:59:100
144999912,71cyclictest9229-21diskmemload11:59:100
144999912,62cyclictest7693-21ntp_kernel_pll_07:24:510
144999912,62cyclictest7693-21ntp_kernel_pll_07:24:510
144999912,60cyclictest28254-21ssh12:26:200
144999907,55cyclictest1437-21cyclictest07:49:360
144999903,58cyclictest22765-21ssh11:24:260
144999903,56cyclictest11068-21ssh10:08:220
144999902,50cyclictest6045-21awk10:54:480
146999892,51cyclictest2500-21cpu10:49:352
144999893,56cyclictest6239-21/usr/sbin/munin08:59:320
144999892,61cyclictest14374-21rm12:04:120
144999892,61cyclictest14374-21rm12:04:120
144999892,57cyclictest6235-21taskset09:59:500
323962885,14sleep10-21swapper/107:04:231
323962885,14sleep10-21swapper/107:04:231
1469998841,26cyclictest141rcu_preempt11:21:082
144999883,75cyclictest28732-21apt-get08:29:270
144999882,60cyclictest6736-21rm11:50:230
144999882,60cyclictest6736-21rm11:50:230
144999882,58cyclictest30990-21ssh10:42:530
144999882,58cyclictest30990-21ssh10:42:530
144999882,57cyclictest9229-21diskmemload10:16:220
144999873,75cyclictest5384-21seq08:54:500
144999873,57cyclictest0-21swapper/010:34:330
1449998734,47cyclictest0-21swapper/008:50:040
1449998728,50cyclictest0-21swapper/012:14:040
144999872,69cyclictest0-21swapper/009:46:520
144999872,57cyclictest3242-21cat11:44:430
144999872,54cyclictest9229-21diskmemload11:08:130
144999872,54cyclictest9229-21diskmemload11:08:130
144999872,52cyclictest16034-21ssh12:05:580
144999871,60cyclictest30721-21ssh11:37:090
144999862,56cyclictest31556-21chrt12:32:080
144999852,76cyclictest13584-21awk09:14:480
144999852,67cyclictest0-21swapper/007:44:470
144999852,55cyclictest0-21swapper/007:58:330
144999852,53cyclictest1945-21ssh09:52:160
144999852,52cyclictest25485-21/usr/sbin/munin08:19:330
144999852,52cyclictest25485-21/usr/sbin/munin08:19:330
144999843,72cyclictest276-21systemd-journal07:09:390
144999842,76cyclictest22268-21grep09:29:520
1449998427,47cyclictest0-21swapper/008:24:420
144999842,56cyclictest1-21systemd09:09:070
144999842,54cyclictest572-21sh10:45:230
144999842,54cyclictest572-21sh10:45:230
144999833,52cyclictest8038-21/usr/sbin/munin10:59:290
144999832,73cyclictest17195-21sshd09:21:390
144999832,72cyclictest23197-21modprobe12:19:040
144999832,61cyclictest0-21swapper/010:21:550
144999832,61cyclictest0-21swapper/010:21:550
144999822,73cyclictest2069-21tail08:44:520
144999822,72cyclictest11743-21latency_hist07:39:090
1449998213,41cyclictest11693-21ssh10:09:270
144999816,69cyclictest0-21swapper/008:34:420
144999813,69cyclictest23801-21/usr/sbin/munin12:19:330
144999812,52cyclictest9229-21diskmemload10:31:260
144999812,52cyclictest9229-21diskmemload10:31:260
1482998034,38cyclictest0-21swapper/311:59:063
1482998034,38cyclictest0-21swapper/311:59:063
146099805,39cyclictest2423-21apt-get10:49:301
1460998045,7cyclictest141rcu_preempt12:11:341
144999802,48cyclictest19576-21sed07:59:460
1482997958,14cyclictest20473-21ssh12:14:223
144999792,67cyclictest20885-21netstat10:24:390
148299783,65cyclictest7783-21latency_hist10:59:073
1469997836,26cyclictest141rcu_preempt08:29:312
1460997844,16cyclictest141rcu_preempt09:47:421
144999783,68cyclictest9716-21unixbench_multi07:29:510
148299774,60cyclictest6459-21sort08:59:313
1469997741,12cyclictest141rcu_preempt11:52:052
1469997741,12cyclictest141rcu_preempt11:52:052
144999772,53cyclictest22790-21ntpq08:09:530
1469997629,28cyclictest141rcu_preempt11:44:352
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional