You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 21:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7.osadl.org (updated Fri Apr 26, 2024 12:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
765327690,14sleep17648-21fschecks_time07:00:341
765327690,14sleep17648-21fschecks_time07:00:341
88539910950,25cyclictest13059-21rm10:55:160
113521030,4chrt1134-21awk09:35:402
113521030,4chrt1134-21awk09:35:402
88789910147,9cyclictest18328-21dpkg09:10:062
8853999937,21cyclictest23864-21modprobe11:15:060
8853999737,24cyclictest4028-21sed12:30:090
8853999636,26cyclictest2838-21kernelversion08:25:290
8853999535,27cyclictest16626-21grep11:00:430
8853999436,20cyclictest32216-21mailstats10:30:420
8853999336,22cyclictest18688-21cut09:10:100
8853999336,21cyclictest0-21swapper/007:26:190
8853999333,27cyclictest17217-21expr10:05:210
8853999250,30cyclictest0-21swapper/012:35:080
8853999238,13cyclictest11964-21modprobe11:50:060
8853999233,31cyclictest3346-21diskmemload11:35:140
8853999233,23cyclictest7186-21sed11:40:430
8853999131,19cyclictest0-21swapper/011:55:050
8853999041,21cyclictest25628-21rm10:20:150
8853999037,25cyclictest408-21ssh09:35:220
8853999037,25cyclictest408-21ssh09:35:220
8853998955,8cyclictest4531-21ssh10:40:210
8853998939,30cyclictest399-21runrttasks08:04:410
8853998934,29cyclictest24937-21ssh12:10:330
8853998934,17cyclictest24386-21apt-get09:20:200
86822896,15sleep20-21swapper/207:04:472
86822896,15sleep20-21swapper/207:04:472
8853998840,12cyclictest5326-21modprobe09:45:060
8853998838,17cyclictest25229-21/usr/sbin/munin11:15:410
8853998837,20cyclictest28747-21seq11:22:260
8853998837,16cyclictest31352-21ssh11:26:310
8853998835,22cyclictest399-21runrttasks07:33:320
8878998711,29cyclictest29391-21/usr/sbin/munin08:05:162
886999873,63cyclictest4586-21/usr/sbin/munin12:31:001
8853998757,21cyclictest14077-21apt-get09:00:520
8853998757,21cyclictest14077-21apt-get09:00:520
8853998749,30cyclictest27297-21idleruntime-cro08:00:060
8853998749,28cyclictest688-21latency_hist12:25:090
8853998742,24cyclictest0-21swapper/010:52:240
8853998738,38cyclictest21244-21cat11:10:090
8853998737,19cyclictest32135-21ssh09:34:090
8853998737,19cyclictest17569-21snmpd07:40:060
8853998737,11cyclictest15308-21apt-get11:55:200
8853998734,20cyclictest15003-21if_eth010:01:280
8853998734,17cyclictest1062-21sort08:15:430
8853998733,23cyclictest13258-21ntp_kernel_pll_07:15:340
8853998725,17cyclictest0-21swapper/009:28:220
8853998639,19cyclictest15919-21sed07:25:090
8853998634,22cyclictest19292-21ssh09:11:210
8853998634,18cyclictest0-21swapper/007:50:470
8853998631,29cyclictest15436-21diskmemload09:18:410
8853998623,33cyclictest30415-21ssh10:27:540
8853998541,15cyclictest467-21ssh11:30:200
8853998541,15cyclictest467-21ssh11:30:200
8853998537,22cyclictest7470-21cstates08:40:220
8853998534,19cyclictest7223-21latency_hist08:40:090
8853998529,35cyclictest0-21swapper/012:00:180
758828510,38sleep07651-21fschecks_time07:00:340
758828510,38sleep07651-21fschecks_time07:00:340
8886998442,13cyclictest276-21systemd-journal09:00:073
8853998438,18cyclictest13577-21latency_hist09:00:100
8853998437,19cyclictest32403-21munin-plugin-st08:15:070
8853998436,18cyclictest21401-21cpu12:05:230
8853998436,18cyclictest21401-21cpu12:05:230
8853998435,19cyclictest23233-21latency10:15:310
8853998435,17cyclictest30809-21cat08:10:080
8853998428,20cyclictest12452-21apt07:15:070
8853998428,20cyclictest12452-21apt07:15:070
8853998335,21cyclictest399-21runrttasks09:55:240
8853998331,19cyclictest0-21swapper/009:48:450
8853998331,19cyclictest0-21swapper/009:48:450
8878998245,13cyclictest33-21ksoftirqd/209:55:292
886999825,40cyclictest14811-21ssh10:01:221
8853998237,14cyclictest9421-21ssh09:50:390
8853998236,16cyclictest22741-21sshd07:45:220
8853998232,22cyclictest11943-21modprobe08:55:060
8869998133,12cyclictest141rcu_preempt11:16:591
8853998130,18cyclictest0-21swapper/008:45:440
8853998129,20cyclictest0-21swapper/010:10:110
887899808,30cyclictest28618-21apt-get10:25:212
8853998037,16cyclictest29191-21ssh12:17:330
8878997961,12cyclictest12458-21munin-plugin-st07:15:072
8878997961,12cyclictest12458-21munin-plugin-st07:15:072
8878997952,10cyclictest33-21ksoftirqd/208:15:292
8878997937,15cyclictest347-21in:imklog08:50:232
8853997932,38cyclictest10552-21latency_hist07:10:090
8853997928,18cyclictest4773-21sensors08:30:380
8853997928,18cyclictest4773-21sensors08:30:380
8853997852,17cyclictest1639-21ssh10:35:150
8853997831,17cyclictest8788-21ssh10:46:490
8878997746,10cyclictest33-21ksoftirqd/211:50:422
8878997745,10cyclictest141rcu_preempt09:40:412
887899772,57cyclictest14326-21kworker/u8:210:00:392
8869997754,12cyclictest12873-21latency_hist10:55:081
29442770,2sleep1231rcuc/111:34:521
29442770,2sleep1231rcuc/111:34:521
8878997657,12cyclictest8315-21grep08:40:412
8878997642,12cyclictest33-21ksoftirqd/211:20:422
8878997640,13cyclictest33-21ksoftirqd/209:15:252
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional