You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-22 - 07:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot6 (updated Fri Sep 22, 2023 00:45:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13566999172,10cyclictest26-21ksoftirqd/120:05:211
1306629015,30sleep10-21swapper/119:06:401
1267628232,36sleep00-21swapper/019:05:390
13564998121,18cyclictest14-21ksoftirqd/021:05:390
13566997863,10cyclictest26-21ksoftirqd/100:25:231
13566997852,14cyclictest26-21ksoftirqd/100:35:191
242642770,13chrt24263-21latency_hist00:14:590
1356499763,15cyclictest14-21ksoftirqd/000:15:190
13564997613,47cyclictest14-21ksoftirqd/000:05:110
13564997533,37cyclictest14-21ksoftirqd/020:00:450
13566997446,18cyclictest26-21ksoftirqd/122:55:221
13566997444,17cyclictest0-21swapper/100:00:211
13564997437,31cyclictest510-21snmpd20:11:220
13564997437,31cyclictest510-21snmpd20:11:220
13566997341,19cyclictest0-21swapper/123:40:221
13564997324,12cyclictest0-21swapper/020:35:190
13566997243,19cyclictest0-21swapper/123:55:191
13566997241,18cyclictest0-21swapper/100:10:241
13566997144,17cyclictest26-21ksoftirqd/119:25:231
13566997141,19cyclictest0-21swapper/122:35:201
13566997141,18cyclictest0-21swapper/100:30:251
13566997112,8cyclictest151rcu_preempt19:35:001
13564997135,30cyclictest14-21ksoftirqd/019:48:300
13566997044,16cyclictest0-21swapper/121:55:211
13566996942,16cyclictest0-21swapper/120:30:201
13566996940,20cyclictest0-21swapper/119:20:211
13566996940,17cyclictest0-21swapper/121:35:231
13566996939,17cyclictest0-21swapper/100:20:201
13566996840,17cyclictest0-21swapper/100:15:141
13564996829,35cyclictest14-21ksoftirqd/022:15:230
1356699674,15cyclictest26-21ksoftirqd/119:50:001
13566996741,17cyclictest31509-21kworker/1:223:25:211
13566996741,15cyclictest0-21swapper/119:15:201
13566996739,16cyclictest0-21swapper/120:10:191
13566996739,16cyclictest0-21swapper/120:10:181
13564996735,8cyclictest14-21ksoftirqd/022:55:240
13564996733,27cyclictest510-21snmpd21:56:410
1356699668,14cyclictest26-21ksoftirqd/123:15:011
1356499663,35cyclictest21796-21kworker/0:221:25:320
13564996629,16cyclictest14-21ksoftirqd/000:35:260
13564996525,8cyclictest14-21ksoftirqd/023:35:530
13564996524,34cyclictest14-21ksoftirqd/000:00:030
13566996439,18cyclictest0-21swapper/123:20:191
1356699643,18cyclictest1227-21idleruntime-cro23:10:001
1356699642,27cyclictest30788-21apt21:29:591
13564996441,8cyclictest14-21ksoftirqd/000:00:340
1356499643,39cyclictest20751-21sed22:30:470
13564996428,20cyclictest14-21ksoftirqd/000:30:340
13564996426,21cyclictest14-21ksoftirqd/023:55:010
1356699639,12cyclictest26-21ksoftirqd/120:24:591
1356699634,24cyclictest20339-21seq21:00:021
13564996334,25cyclictest14-21ksoftirqd/022:40:290
13564996331,27cyclictest27618-21telnet21:20:240
13564996319,37cyclictest30391-21aten2.4-expect23:00:330
13566996235,16cyclictest0-21swapper/120:00:211
1356699622,11cyclictest4713-21basename23:19:591
1356499627,7cyclictest151rcu_preempt22:01:310
1356499625,10cyclictest0-21swapper/022:55:010
13564996233,24cyclictest14-21ksoftirqd/019:35:260
13564996228,11cyclictest14-21ksoftirqd/021:10:410
13564996226,12cyclictest14-21ksoftirqd/023:40:280
1356699614,23cyclictest1297-21cron22:20:001
13566996139,15cyclictest13558-21cyclictest20:35:161
1356699613,13cyclictest24915-21munin-run22:44:591
13566996111,17cyclictest151rcu_preempt23:55:001
13566996111,17cyclictest151rcu_preempt21:10:001
1356499619,40cyclictest151rcu_preempt20:50:170
13564996137,18cyclictest14-21ksoftirqd/022:35:250
13564996128,11cyclictest14-21ksoftirqd/020:55:390
13564996124,19cyclictest14-21ksoftirqd/019:20:420
13564996120,11cyclictest14-21ksoftirqd/023:50:000
1356699603,22cyclictest1297-21cron20:00:001
1356699603,11cyclictest28379-21munin-run22:55:001
1356699603,11cyclictest15188-21munin-run23:50:011
13564996037,8cyclictest14-21ksoftirqd/019:25:300
13564996036,8cyclictest14-21ksoftirqd/021:37:390
13564996035,9cyclictest14-21ksoftirqd/022:25:350
13564996027,27cyclictest510-21snmpd22:11:450
13564996024,11cyclictest14-21ksoftirqd/020:20:220
13564996023,11cyclictest14-21ksoftirqd/019:15:070
13564996022,21cyclictest14-21ksoftirqd/020:40:420
13566995933,22cyclictest467-21dbus-daemon19:54:591
13566995924,26cyclictest467-21dbus-daemon20:20:011
1356699592,23cyclictest26-21ksoftirqd/122:00:061
13564995937,8cyclictest14-21ksoftirqd/023:25:280
13564995936,8cyclictest14-21ksoftirqd/021:15:420
13564995936,8cyclictest14-21ksoftirqd/000:24:300
13564995935,9cyclictest14-21ksoftirqd/022:07:310
13564995935,8cyclictest14-21ksoftirqd/021:54:090
13564995935,18cyclictest14-21ksoftirqd/023:05:220
13564995930,12cyclictest14-21ksoftirqd/020:50:010
13564995928,9cyclictest14-21ksoftirqd/019:10:350
13564995925,12cyclictest14-21ksoftirqd/000:25:300
13566995832,21cyclictest467-21dbus-daemon21:34:301
1356699583,12cyclictest9813-21latency_hist20:30:011
1356699583,11cyclictest15255-21apt-get20:45:181
13566995828,22cyclictest255-21systemd-journal19:36:151
1356499585,9cyclictest0-21swapper/023:11:010
1356499585,47cyclictest0-21swapper/021:44:440
13564995841,11cyclictest28866-21ntpq19:50:400
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional