You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-03 - 07:54

x86 Intel N455 @1660 MHz, Linux 5.4.34-rt21 (Profile)

Latency plot of system in rack #3, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6 (updated Sun Jul 03, 2022 00:45:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1051121620,14sleep12396399cyclictest23:15:061
2395899960,17cyclictest29957-21taskset19:25:240
2395899960,17cyclictest29957-21taskset19:25:230
2395899946,78cyclictest22403-21apt-get20:40:110
23963999310,58cyclictest0-21swapper/119:30:131
2340329322,32sleep00-21swapper/019:05:300
2395899920,17cyclictest2904-21apt-get22:55:150
2395899920,13cyclictest807-21/usr/sbin/munin21:10:360
2395899920,13cyclictest807-21/usr/sbin/munin21:10:350
2395899919,68cyclictest4970-21apt-get21:25:140
2395899918,72cyclictest27177-21apt-get22:30:110
2396399908,58cyclictest0-21swapper/120:10:131
2396399907,57cyclictest0-21swapper/120:30:151
2395899909,66cyclictest5451-21apt-get19:50:130
2395899908,67cyclictest19143-21apt-get23:40:130
2395899900,18cyclictest6250-21ntp_states00:35:310
2395899900,17cyclictest25835-21grep19:15:040
2395899900,13cyclictest414-21dbus-daemon22:05:000
23963998911,53cyclictest0-21swapper/120:35:151
23963998911,53cyclictest0-21swapper/120:35:141
2395899899,66cyclictest25733-21apt-get20:50:140
23958998910,71cyclictest31354-21apt-get00:15:140
23958998910,65cyclictest1410-21apt-get22:50:120
2395899890,16cyclictest21066-21apt-get23:45:160
2395899890,16cyclictest20068-21apt-get22:10:120
2395899889,63cyclictest13564-21apt-get21:50:120
2395899887,67cyclictest17459-21apt-get23:35:110
2395899887,67cyclictest12384-21apt-get20:10:130
2395899887,64cyclictest25512-21apt-get22:25:110
2395899880,15cyclictest13480-21grep23:20:470
2395899880,14cyclictest9702-21ntp_kernel_err20:00:390
2395899879,62cyclictest8558-21apt-get21:35:130
2395899878,65cyclictest2133-21apt-get19:40:140
2395899878,64cyclictest5017-21apt-get23:00:140
2395899877,66cyclictest15225-21apt-get21:55:130
2395899870,15cyclictest30330-21latency_hist22:40:000
2395899870,12cyclictest32268-21/usr/sbin/munin22:45:150
2396399868,56cyclictest0-21swapper/100:15:151
2396399868,55cyclictest0-21swapper/119:55:141
2395899869,67cyclictest2264-21apt-get00:25:160
2395899869,65cyclictest30738-21apt-get21:05:120
2395899868,66cyclictest14044-21apt-get20:15:120
2395899868,65cyclictest27897-21apt-get19:20:130
2395899868,65cyclictest26364-21apt-get00:00:250
2395899868,65cyclictest26364-21apt-get00:00:250
2395899867,65cyclictest7111-21apt-get19:55:130
2395899867,65cyclictest10242-21apt-get21:40:120
2395899859,64cyclictest10723-21apt-get20:05:120
2395899858,66cyclictest20721-21apt-get20:35:120
2395899858,66cyclictest20721-21apt-get20:35:110
2395899858,65cyclictest31220-21apt-get19:30:110
2395899858,65cyclictest10524-21apt-get23:15:250
2395899857,67cyclictest3793-21apt-get19:45:120
2395899857,63cyclictest30526-21apt-get22:40:120
2395899857,63cyclictest22163-21apt-get22:15:130
2395899857,62cyclictest18571-21apt-get22:05:120
2395899850,17cyclictest6460-21apt-get21:30:150
2395899850,15cyclictest29266-21diskstats21:00:200
2395899850,14cyclictest15617-21cron23:30:000
2395899850,13cyclictest29880-21diskstats00:10:200
2395899850,13cyclictest1000-21irqstats00:20:240
2396399848,56cyclictest0-21swapper/119:40:151
2396399848,22cyclictest0-21swapper/120:55:141
23963998413,45cyclictest0-21swapper/123:35:161
2395899849,62cyclictest23849-21apt-get22:20:130
2395899849,60cyclictest1624-21apt-get21:15:140
2395899848,66cyclictest27393-21apt-get20:55:130
2395899848,64cyclictest19058-21apt-get20:30:130
2395899848,63cyclictest3925-21apt-get00:30:160
2395899848,62cyclictest6937-21apt-get23:05:250
2395899847,64cyclictest28028-21apt-get00:05:120
2395899847,62cyclictest8603-21apt-get23:10:130
2395899846,65cyclictest22732-21apt-get23:50:140
23958998432,46cyclictest276-21systemd-journal23:55:010
23958998410,62cyclictest17394-21apt-get20:25:110
2395899840,13cyclictest3987-21ntp_states21:20:440
2396399838,55cyclictest0-21swapper/122:30:121
2396399837,56cyclictest0-21swapper/119:10:121
2396399837,54cyclictest0-21swapper/120:50:131
23963998334,29cyclictest21-21ksoftirqd/121:40:141
23963998316,48cyclictest0-21swapper/123:00:131
2395899837,67cyclictest24071-21apt-get20:45:110
2395899837,62cyclictest24045-21apt-get19:10:120
2395899830,12cyclictest16624-21sed20:20:350
2395899830,12cyclictest1083-21ntpq19:35:270
2395899827,62cyclictest11905-21apt-get21:45:130
2395899820,10cyclictest16443-21ntpq23:30:280
2395899820,10cyclictest16443-21ntpq23:30:270
2396399817,26cyclictest111rcu_preempt23:10:121
23963998134,28cyclictest0-21swapper/122:05:121
2396399798,51cyclictest0-21swapper/100:10:121
2361327936,33sleep10-21swapper/119:07:381
2396399768,17cyclictest0-21swapper/123:50:131
2396399767,50cyclictest0-21swapper/122:50:121
23963997610,45cyclictest0-21swapper/122:20:131
2396399758,48cyclictest0-21swapper/100:30:131
2396399758,46cyclictest0-21swapper/100:35:131
2396399757,18cyclictest0-21swapper/122:10:251
23963997510,21cyclictest0-21swapper/123:20:261
23963997124,31cyclictest21-21ksoftirqd/119:20:121
23963997124,30cyclictest21-21ksoftirqd/121:00:141
2396399707,44cyclictest0-21swapper/121:15:141
23963997028,25cyclictest0-21swapper/121:05:151
23963997026,23cyclictest0-21swapper/120:45:121
23963996825,26cyclictest21-21ksoftirqd/121:20:231
23963996823,26cyclictest21-21ksoftirqd/121:35:111
23963996822,27cyclictest21-21ksoftirqd/122:35:121
2396399677,21cyclictest0-21swapper/122:25:131
23963996724,27cyclictest21-21ksoftirqd/120:00:251
2396399668,45cyclictest0-21swapper/100:05:121
23963996623,29cyclictest21-21ksoftirqd/121:55:131
23963996525,27cyclictest21-21ksoftirqd/121:10:151
23963996525,27cyclictest21-21ksoftirqd/121:10:151
23963996519,24cyclictest0-21swapper/123:25:111
23963996510,9cyclictest21-21ksoftirqd/100:00:071
23963996510,9cyclictest21-21ksoftirqd/100:00:061
23963996427,24cyclictest0-21swapper/120:05:131
2396399639,9cyclictest21-21ksoftirqd/120:20:011
2396399633,42cyclictest0-21swapper/119:15:111
23963996326,23cyclictest21-21ksoftirqd/123:40:141
23963996325,23cyclictest21-21ksoftirqd/121:50:151
2396399626,12cyclictest0-21swapper/119:25:151
2396399626,12cyclictest0-21swapper/119:25:141
23963996119,23cyclictest0-21swapper/100:20:111
23963995925,11cyclictest21-21ksoftirqd/121:35:001
23963995924,12cyclictest21-21ksoftirqd/122:50:001
23963995922,13cyclictest21-21ksoftirqd/119:35:331
23963995916,27cyclictest21-21ksoftirqd/119:45:151
23963995916,23cyclictest0-21swapper/120:25:111
23963995825,11cyclictest22811-21ntpq22:15:301
23963995816,26cyclictest0-21swapper/122:55:251
23963995814,29cyclictest21-21ksoftirqd/122:40:131
23963995812,29cyclictest0-21swapper/123:55:161
2396399579,30cyclictest0-21swapper/120:20:121
2396399578,32cyclictest21-21ksoftirqd/122:00:121
23963995723,11cyclictest21-21ksoftirqd/119:55:001
23963995715,25cyclictest0-21swapper/120:40:121
23963995622,12cyclictest21-21ksoftirqd/123:45:351
23963995620,24cyclictest21-21ksoftirqd/100:25:141
23963995611,26cyclictest0-21swapper/123:30:141
23963995611,26cyclictest0-21swapper/123:30:131
23963995517,14cyclictest21-21ksoftirqd/121:45:231
23963995511,28cyclictest0-21swapper/123:05:261
23963995510,23cyclictest0-21swapper/121:25:151
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:363
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
none15:02:362
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional