You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-06 - 13:05

x86 Intel N455 @1660 MHz, Linux 5.4.34-rt21 (Profile)

Latency plot of system in rack #3, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack3slot6 (updated Wed Jul 06, 2022 00:45:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
64169910519,68cyclictest0-21swapper/119:55:241
6411991030,13cyclictest4977-21irqstats22:15:230
6411991010,11cyclictest17641-21chrt21:16:200
64169910022,64cyclictest0-21swapper/120:30:111
6411991005,21cyclictest8168-21apt-get20:50:130
6411991000,9cyclictest0-21swapper/022:05:150
6411991000,11cyclictest540-21runrttasks00:07:480
6416999924,64cyclictest6399-21cyclictest20:00:111
6416999924,64cyclictest6399-21cyclictest20:00:101
641199990,13cyclictest32233-21ps23:35:320
641199990,11cyclictest28042-21chrt21:47:400
641199980,9cyclictest0-21swapper/023:50:270
641199980,13cyclictest11617-21tr21:00:160
641199980,11cyclictest21835-21apt-get19:55:070
641199980,11cyclictest19464-21sensors_fan19:45:400
641199980,11cyclictest19464-21sensors_fan19:45:390
6416999725,57cyclictest0-21swapper/123:25:231
6416999725,57cyclictest0-21swapper/123:25:221
6416999716,68cyclictest0-21swapper/120:20:131
641199970,9cyclictest0-21swapper/023:45:200
6416999618,64cyclictest0-21swapper/120:45:111
6416999617,65cyclictest0-21swapper/123:40:121
6416999617,65cyclictest0-21swapper/100:05:121
6416999617,63cyclictest0-21swapper/119:30:121
6416999615,66cyclictest0-21swapper/120:05:121
641199960,9cyclictest0-21swapper/020:55:190
641199960,10cyclictest8638-21ntpq00:00:310
641699959,23cyclictest540-21runrttasks21:30:141
641699959,23cyclictest540-21runrttasks21:30:131
6416999517,65cyclictest0-21swapper/120:25:131
6416999516,66cyclictest0-21swapper/122:30:221
641199950,9cyclictest0-21swapper/019:25:230
641199950,10cyclictest0-21swapper/020:15:310
6416999418,61cyclictest0-21swapper/119:15:121
641199940,16cyclictest19444-21cron00:34:590
641199940,10cyclictest0-21swapper/023:10:190
6416999319,59cyclictest0-21swapper/123:05:131
6416999317,60cyclictest0-21swapper/123:45:211
641199936,28cyclictest14603-21apt-get22:45:110
480129331,49sleep00-21swapper/019:05:110
6416999219,60cyclictest0-21swapper/122:05:131
6416999214,67cyclictest0-21swapper/119:45:211
6416999214,67cyclictest0-21swapper/119:45:201
641199925,24cyclictest28432-21apt-get21:50:140
641199920,7cyclictest0-21swapper/022:33:310
6416999119,59cyclictest0-21swapper/123:55:121
6416999117,61cyclictest0-21swapper/123:30:131
6416999115,58cyclictest0-21swapper/120:10:121
6416999114,61cyclictest0-21swapper/120:50:141
641199916,74cyclictest17020-21apt-get19:40:110
641199916,73cyclictest25609-21apt-get20:05:120
641199910,11cyclictest14113-21ls19:30:240
6416999017,59cyclictest0-21swapper/123:50:161
6416999016,58cyclictest0-21swapper/119:50:131
641199906,23cyclictest4840-21apt-get20:40:100
641199906,20cyclictest18440-21apt-get21:20:220
6416998918,58cyclictest0-21swapper/122:45:111
6416998917,58cyclictest0-21swapper/120:15:161
6416998915,64cyclictest2917-21apt-get22:10:151
6416998915,58cyclictest0-21swapper/100:00:161
641699888,22cyclictest3162-21apt-get20:35:121
641699887,22cyclictest12942-21apt-get22:40:131
6416998828,15cyclictest414-21dbus-daemon19:40:011
6416998817,55cyclictest0-21swapper/123:35:121
6416998814,58cyclictest0-21swapper/121:35:121
641199886,23cyclictest28196-21apt-get23:25:220
641199886,23cyclictest28196-21apt-get23:25:220
641199885,21cyclictest21766-21apt-get21:30:130
641199885,21cyclictest21766-21apt-get21:30:130
641699878,23cyclictest24591-21apt-get23:15:111
641699877,23cyclictest16300-21apt-get00:25:121
641699876,21cyclictest14635-21apt-get00:20:121
6416998715,58cyclictest0-21swapper/121:20:231
6416998714,60cyclictest0-21swapper/120:40:131
6416998713,62cyclictest0-21swapper/119:40:111
641199876,69cyclictest6507-21apt-get20:45:110
641199875,24cyclictest19618-21apt-get00:35:130
641199875,20cyclictest27267-21apt-get20:10:120
641199875,20cyclictest23943-21apt-get20:00:110
641199875,20cyclictest23943-21apt-get20:00:110
641699867,22cyclictest30091-21apt-get21:55:121
641699867,22cyclictest11260-21apt-get22:35:121
6416998615,58cyclictest0-21swapper/122:50:131
641699857,20cyclictest9832-21apt-get20:55:131
641699856,26cyclictest26771-21apt-get21:45:121
6416998525,16cyclictest14038-21sed21:05:361
641199856,68cyclictest8667-21apt-get19:15:130
641199856,20cyclictest11260-21apt-get22:35:150
641199855,69cyclictest32272-21apt-get20:25:140
641199855,69cyclictest21269-21apt-get23:05:130
641199854,23cyclictest16266-21apt-get22:50:150
641199850,14cyclictest13360-21diskstats21:05:190
641699847,22cyclictest22931-21apt-get23:10:131
641699847,20cyclictest19618-21apt-get00:35:141
641699847,19cyclictest6502-21apt-get19:10:121
641699847,19cyclictest16497-21apt-get21:15:141
641699846,20cyclictest31773-21apt-get22:00:121
641699846,19cyclictest28432-21apt-get21:50:131
641699846,18cyclictest20102-21apt-get21:25:121
641199845,68cyclictest1498-21apt-get20:30:100
641199840,9cyclictest0-21swapper/021:10:270
641199840,8cyclictest0-21swapper/023:19:040
641199840,16cyclictest18580-21ntp_states22:55:270
641199840,14cyclictest11066-21ps19:20:310
641699837,23cyclictest4581-21apt-get22:15:141
641699837,19cyclictest26273-21apt-get23:20:141
641699836,19cyclictest6267-21apt-get22:20:131
641699836,19cyclictest11513-21apt-get21:00:121
6416998314,58cyclictest0-21swapper/122:25:131
641199836,66cyclictest29859-21apt-get23:30:130
641199835,21cyclictest7933-21apt-get22:25:140
641199834,64cyclictest30613-21apt-get20:20:130
641199830,8cyclictest0-21swapper/023:00:320
641199830,8cyclictest0-21swapper/020:36:320
641199830,13cyclictest15451-21cstates19:35:150
641199830,12cyclictest20513-21kernelversion21:25:240
641699827,21cyclictest25111-21apt-get21:40:131
641699827,21cyclictest14846-21apt-get21:10:221
641699826,19cyclictest12950-21apt-get00:15:131
641699826,19cyclictest12950-21apt-get00:15:131
641199820,9cyclictest0-21swapper/021:41:230
641199820,14cyclictest6462-21diskstats23:55:200
641199820,10cyclictest2917-21apt-get22:10:120
641699817,22cyclictest11289-21apt-get00:10:141
641699816,21cyclictest17924-21apt-get22:55:131
641699816,19cyclictest19607-21apt-get23:00:141
6416998125,16cyclictest276-21systemd-journal19:21:061
641199816,62cyclictest23429-21apt-get21:35:130
641199815,61cyclictest768-21apt-get23:40:110
641199814,21cyclictest14635-21apt-get00:20:150
641199810,9cyclictest0-21swapper/023:20:150
641199810,13cyclictest17068-21sensors_fan00:25:320
641199810,13cyclictest13101-21cstates22:40:150
641199810,12cyclictest6461-21diskstats22:20:190
641199810,12cyclictest31960-21diskstats22:00:200
641699806,22cyclictest12014-21apt-get19:25:131
641199805,21cyclictest11289-21apt-get00:10:140
641199800,11cyclictest30745-21ntp_states21:55:270
622328047,23sleep10-21swapper/119:09:191
641199790,9cyclictest0-21swapper/019:50:120
641199790,10cyclictest7935-21runrttasks19:14:270
641699787,22cyclictest17959-21apt-get00:30:151
641199770,9cyclictest0-21swapper/000:18:000
641199770,9cyclictest0-21swapper/000:17:590
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional