You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-31 - 11:57

x86 Intel N455 @1660 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #3, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack3slot6 (updated Tue Jan 31, 2023 00:45:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23119912998,20cyclictest14-21ksoftirqd/000:25:180
23119912699,13cyclictest14-21ksoftirqd/021:05:210
23119912391,17cyclictest14-21ksoftirqd/023:30:190
23119912294,19cyclictest14-21ksoftirqd/023:00:210
23119912293,18cyclictest14-21ksoftirqd/023:40:260
23119912288,21cyclictest14-21ksoftirqd/020:40:230
23119912190,19cyclictest14-21ksoftirqd/022:10:210
23119912189,20cyclictest14-21ksoftirqd/019:40:210
23119911990,19cyclictest14-21ksoftirqd/021:15:160
23119911912,92cyclictest0-21swapper/021:45:180
23119911886,20cyclictest14-21ksoftirqd/020:10:230
23119911883,23cyclictest14-21ksoftirqd/020:15:190
23119911787,20cyclictest14-21ksoftirqd/019:10:140
23119911784,21cyclictest14-21ksoftirqd/023:25:180
23119911613,85cyclictest0-21swapper/020:05:180
23119911584,21cyclictest14-21ksoftirqd/021:25:190
23119911581,19cyclictest14-21ksoftirqd/019:25:160
23119911580,18cyclictest14-21ksoftirqd/020:45:180
23129911481,20cyclictest26-21ksoftirqd/119:50:161
23129911481,20cyclictest26-21ksoftirqd/119:50:161
23119911387,17cyclictest14-21ksoftirqd/021:10:200
23119911384,16cyclictest14-21ksoftirqd/023:55:200
23119911384,16cyclictest14-21ksoftirqd/023:55:200
23119911381,21cyclictest14-21ksoftirqd/019:55:170
23119911381,21cyclictest14-21ksoftirqd/019:55:170
23119911323,74cyclictest0-21swapper/023:05:180
23119911316,80cyclictest0-21swapper/021:35:200
23119911315,82cyclictest0-21swapper/022:05:180
23119911314,81cyclictest0-21swapper/021:30:180
23119911283,20cyclictest14-21ksoftirqd/000:05:190
23119911282,20cyclictest14-21ksoftirqd/021:00:200
23119911280,22cyclictest0-21swapper/000:10:240
23119911280,18cyclictest0-21swapper/021:50:180
23119911211,83cyclictest0-21swapper/019:35:170
23119911181,19cyclictest14-21ksoftirqd/000:15:170
23119911179,22cyclictest14-21ksoftirqd/022:15:190
23119911177,20cyclictest14-21ksoftirqd/022:50:180
23119911113,82cyclictest0-21swapper/022:45:200
23119911111,82cyclictest0-21swapper/021:20:210
23119911110,85cyclictest0-21swapper/021:40:220
23119911081,17cyclictest14-21ksoftirqd/019:30:180
23119911075,20cyclictest0-21swapper/023:45:220
23119911014,82cyclictest0-21swapper/020:30:160
23119910874,20cyclictest14-21ksoftirqd/023:50:200
23119910874,20cyclictest0-21swapper/022:55:190
23119910824,72cyclictest0-21swapper/020:20:270
23119910824,72cyclictest0-21swapper/020:20:270
23119910814,35cyclictest0-21swapper/020:25:170
23119910812,82cyclictest0-21swapper/019:20:190
23119910811,82cyclictest0-21swapper/023:35:190
23119910770,21cyclictest14-21ksoftirqd/022:25:220
23119910714,81cyclictest0-21swapper/019:45:190
23119910677,19cyclictest14-21ksoftirqd/022:00:180
23119910677,19cyclictest14-21ksoftirqd/022:00:180
23129910559,34cyclictest26-21ksoftirqd/123:55:201
23129910559,34cyclictest26-21ksoftirqd/123:55:201
23119910575,20cyclictest14-21ksoftirqd/020:00:180
23119910572,19cyclictest14-21ksoftirqd/022:40:230
23119910516,35cyclictest0-21swapper/000:00:200
23119910514,79cyclictest0-21swapper/000:20:190
23119910473,19cyclictest14-21ksoftirqd/023:15:170
23119910372,18cyclictest14-21ksoftirqd/020:55:170
23119910369,20cyclictest14-21ksoftirqd/023:20:190
23119910368,22cyclictest14-21ksoftirqd/022:30:190
23119910313,75cyclictest0-21swapper/000:30:200
23119910253,36cyclictest14-21ksoftirqd/022:35:160
23119910253,36cyclictest14-21ksoftirqd/022:35:160
2311999963,22cyclictest0-21swapper/020:35:170
178929921,28sleep00-21swapper/019:07:010
2311999866,20cyclictest14-21ksoftirqd/022:20:170
2311999866,20cyclictest14-21ksoftirqd/022:20:170
2311999863,23cyclictest14-21ksoftirqd/019:50:190
2311999863,23cyclictest14-21ksoftirqd/019:50:180
2311999858,27cyclictest14-21ksoftirqd/021:55:160
231199984,58cyclictest0-21swapper/020:50:170
2312999410,59cyclictest0-21swapper/122:40:251
2312999341,43cyclictest26-21ksoftirqd/120:10:201
2311999149,30cyclictest14-21ksoftirqd/023:10:240
2311999024,54cyclictest0-21swapper/019:15:160
2311998840,35cyclictest14-21ksoftirqd/000:35:210
2312998628,37cyclictest0-21swapper/100:35:201
58328530,40sleep10-21swapper/119:05:161
2312998321,47cyclictest26-21ksoftirqd/123:35:221
2312998127,33cyclictest1070-21kworker/1:221:35:431
2312997923,35cyclictest0-21swapper/119:20:171
2312997710,38cyclictest7424-21apt-get00:05:171
2312997556,10cyclictest26-21ksoftirqd/119:10:261
231299744,22cyclictest151rcu_preempt21:30:191
2312997415,43cyclictest26-21ksoftirqd/122:45:191
2312997343,11cyclictest492-21rs:main1
231299718,39cyclictest48482sleep120:50:191
2312997113,29cyclictest0-21swapper/119:15:181
231299707,20cyclictest3145-21apt-get20:45:181
2312997012,35cyclictest0-21swapper/123:20:211
2312996711,33cyclictest0-21swapper/119:35:201
231299667,53cyclictest0-21swapper/100:00:461
231299663,44cyclictest9227-21grep22:35:411
231299663,44cyclictest9227-21grep22:35:411
2312996613,31cyclictest0-21swapper/122:00:191
2312996613,31cyclictest0-21swapper/122:00:191
2312996512,45cyclictest0-21swapper/120:30:271
231299645,39cyclictest151rcu_preempt22:55:221
2312996437,20cyclictest26-21ksoftirqd/122:20:441
2312996437,20cyclictest26-21ksoftirqd/122:20:441
2312996411,34cyclictest0-21swapper/119:25:171
231299634,38cyclictest0-21swapper/121:55:021
2312996337,19cyclictest26-21ksoftirqd/120:55:171
2312996323,14cyclictest26-21ksoftirqd/120:20:491
2312996323,14cyclictest26-21ksoftirqd/120:20:481
231299627,14cyclictest151rcu_preempt00:30:001
2312996135,9cyclictest26-21ksoftirqd/120:40:401
2312996132,17cyclictest26-21ksoftirqd/119:35:011
2312996125,17cyclictest4988-21cpu22:25:251
231299612,18cyclictest29394-21snmpd21:43:151
2312996114,11cyclictest26-21ksoftirqd/122:50:261
2312996043,10cyclictest26-21ksoftirqd/121:05:461
2312996036,18cyclictest26-21ksoftirqd/123:15:441
2312996036,18cyclictest26-21ksoftirqd/120:15:251
231299603,25cyclictest485-21avahi-daemon23:35:001
2312996031,9cyclictest26-21ksoftirqd/121:23:121
231299599,12cyclictest26-21ksoftirqd/122:08:241
2312995943,10cyclictest26-21ksoftirqd/123:50:451
231299594,14cyclictest1296-21/usr/sbin/munin20:40:011
2312995941,10cyclictest26-21ksoftirqd/123:30:001
2312995940,11cyclictest4010-21munin-node22:10:191
2312995935,18cyclictest26-21ksoftirqd/120:26:031
2312995934,18cyclictest26-21ksoftirqd/123:05:471
231299586,47cyclictest0-21swapper/120:05:011
231299586,46cyclictest0-21swapper/123:40:361
2312995840,10cyclictest26-21ksoftirqd/123:45:531
2312995840,10cyclictest26-21ksoftirqd/121:45:291
2312995840,10cyclictest26-21ksoftirqd/119:40:191
2312995839,11cyclictest26-21ksoftirqd/100:30:311
2312995836,16cyclictest26-21ksoftirqd/119:50:001
231299583,30cyclictest16749-21dpkg21:25:041
2312995829,21cyclictest12282-21cron00:20:001
2312995829,14cyclictest26-21ksoftirqd/120:00:011
2312995829,14cyclictest26-21ksoftirqd/120:00:011
2312995827,23cyclictest26-21ksoftirqd/123:05:011
231299574,14cyclictest20619-21apt-get23:10:251
2312995740,9cyclictest26-21ksoftirqd/100:10:251
2312995740,10cyclictest26-21ksoftirqd/120:10:001
2312995739,11cyclictest26-21ksoftirqd/121:15:211
2312995738,12cyclictest26-21ksoftirqd/122:15:291
231299573,29cyclictest12692-21/usr/sbin/munin00:20:291
231299573,22cyclictest8172-21/usr/sbin/munin21:00:271
231299573,11cyclictest28742-21munin-run22:00:001
2312995638,12cyclictest26-21ksoftirqd/122:32:331
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:323
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
none18:41:322
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional