You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-16 - 13:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7.osadl.org (updated Mon Jun 16, 2025 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2775221156,17sleep20-21swapper/219:04:002
28208991143,83cyclictest8281-21chrt00:03:273
281959910951,16cyclictest11043-21http23:13:011
282039910819,50cyclictest39-21ksoftirqd/220:38:012
281889910331,43cyclictest0-21swapper/023:52:450
281889910331,43cyclictest0-21swapper/023:52:450
28195991002,76cyclictest22468-21apt-get00:28:071
281889910044,21cyclictest27954-21ssh23:41:320
2819599993,68cyclictest8418-21ssh00:03:311
28203999831,35cyclictest39-21ksoftirqd/221:21:452
28203999831,35cyclictest39-21ksoftirqd/221:21:452
28195999851,16cyclictest181rcu_preempt21:48:141
28188999711,47cyclictest0-21swapper/022:37:570
28195999550,24cyclictest181rcu_preempt20:08:061
28195999547,13cyclictest181rcu_preempt22:22:481
28203999421,36cyclictest39-21ksoftirqd/221:48:562
28195999456,9cyclictest181rcu_preempt19:07:481
28195999334,20cyclictest0-21swapper/119:28:091
28203999170,15cyclictest364-21ntpd23:33:392
28188999117,37cyclictest0-21swapper/022:15:040
28203999022,33cyclictest39-21ksoftirqd/219:35:562
28195998957,13cyclictest181rcu_preempt19:53:171
28195998951,17cyclictest181rcu_preempt21:17:201
28195998936,12cyclictest0-21swapper/100:23:281
28195998936,12cyclictest0-21swapper/100:23:281
268792899,49sleep026917-21grep19:03:090
28203998861,15cyclictest4604-21latency_hist23:57:452
28195998860,11cyclictest181rcu_preempt22:10:451
28195998849,16cyclictest181rcu_preempt22:30:291
28195998833,12cyclictest28177-21cyclictest19:33:011
28195998827,12cyclictest0-21swapper/119:58:051
28195998827,12cyclictest0-21swapper/119:58:051
28203998774,8cyclictest0-21swapper/222:38:162
28195998749,15cyclictest181rcu_preempt23:38:061
28195998746,10cyclictest181rcu_preempt22:43:191
28195998744,10cyclictest31765-21kworker/u17:2-rpciod22:55:491
2820399865,39cyclictest39-21ksoftirqd/200:27:062
2820399865,39cyclictest39-21ksoftirqd/200:27:062
28203998621,35cyclictest39-21ksoftirqd/222:18:052
28195998644,13cyclictest181rcu_preempt19:43:151
28195998629,18cyclictest0-21swapper/121:23:541
28195998629,18cyclictest0-21swapper/121:23:541
2819599862,48cyclictest1449-21apt-get19:23:171
28195998557,13cyclictest181rcu_preempt20:03:001
28195998551,12cyclictest181rcu_preempt23:52:501
28195998543,10cyclictest181rcu_preempt21:58:501
28195998543,10cyclictest181rcu_preempt21:58:501
28195998537,17cyclictest0-21swapper/122:05:241
28195998534,28cyclictest0-21swapper/122:18:381
28195998532,30cyclictest0-21swapper/120:21:041
28195998532,30cyclictest0-21swapper/120:21:041
28188998510,48cyclictest20472-21seq20:21:450
28188998510,48cyclictest20472-21seq20:21:450
28195998446,8cyclictest181rcu_preempt23:34:441
28195998444,11cyclictest26396-21switchtime20:38:191
28195998443,10cyclictest13520-21kworker/u17:3-rpciod00:14:461
2818899844,31cyclictest9160-21tune2fs21:18:060
2818899844,31cyclictest9160-21tune2fs21:18:060
28188998416,34cyclictest0-21swapper/023:28:540
28188998416,34cyclictest0-21swapper/023:28:540
28195998362,8cyclictest181rcu_preempt21:11:511
28195998347,8cyclictest181rcu_preempt23:02:451
28195998347,8cyclictest181rcu_preempt23:02:451
28195998339,8cyclictest181rcu_preempt19:52:461
28195998333,13cyclictest0-21swapper/123:22:451
28195998329,11cyclictest0-21swapper/123:31:501
28195998329,11cyclictest0-21swapper/123:31:501
28188998361,16cyclictest18934-21sh20:17:430
28203998251,7cyclictest181rcu_preempt00:28:072
28203998224,35cyclictest39-21ksoftirqd/221:24:572
28203998224,35cyclictest39-21ksoftirqd/221:24:572
28203998217,38cyclictest39-21ksoftirqd/221:59:572
28203998217,38cyclictest39-21ksoftirqd/221:59:572
28203998217,36cyclictest39-21ksoftirqd/222:03:362
28195998255,18cyclictest23373-21kworker/u17:4-xprtiod21:53:041
28195998240,14cyclictest181rcu_preempt20:48:111
28195998240,14cyclictest181rcu_preempt20:48:111
28195998231,28cyclictest0-21swapper/100:33:251
2818899826,33cyclictest24746-21munin-run00:32:410
28188998263,13cyclictest1141-21latency_hist19:22:450
28188998262,15cyclictest2649-21latency_hist22:02:450
28188998262,15cyclictest2649-21latency_hist22:02:450
28203998154,9cyclictest181rcu_preempt00:21:172
28203998154,9cyclictest181rcu_preempt00:21:172
28203998154,8cyclictest181rcu_preempt22:49:312
28203998154,8cyclictest181rcu_preempt22:49:312
28203998148,7cyclictest181rcu_preempt23:38:072
28203998140,20cyclictest32649-21ntpq20:58:132
28195998145,9cyclictest181rcu_preempt23:43:581
28195998136,8cyclictest0-21swapper/120:43:051
28195998131,26cyclictest0-21swapper/120:33:211
28195998130,24cyclictest0-21swapper/122:13:281
28195998127,23cyclictest0-21swapper/119:18:171
28188998121,35cyclictest2651-21diskmemload23:33:260
28203998045,8cyclictest181rcu_preempt20:36:202
28203998042,8cyclictest181rcu_preempt23:21:502
28203998039,20cyclictest11597-21ntpq19:53:102
28203998037,21cyclictest32393-21irqstats19:18:082
28203998037,20cyclictest8121-21apt-get23:07:572
28203998037,20cyclictest8121-21apt-get23:07:572
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional