You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-10-17 - 15:20

Intel(R) Atom(TM) CPU N455 @ 1.66GHz, Linux 5.4.34-rt21 (Profile)

Latency plot of system in rack #3, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack3slot6 (updated Sun Oct 17, 2021 12:45:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
665521480,7sleep10-21swapper/107:05:261
665521480,7sleep10-21swapper/107:05:251
1404721100,9sleep1768599cyclictest12:10:461
7222210421,45sleep00-21swapper/007:06:250
7222210421,45sleep00-21swapper/007:06:250
76779910153,41cyclictest16616-21apt-get07:35:190
76779910153,41cyclictest16616-21apt-get07:35:180
76779910054,37cyclictest4361-21apt-get10:10:190
7685999037,18cyclictest6084-21sendmail-msp08:40:191
184652900,4sleep1201rcuc/107:40:231
7677998858,19cyclictest21735-21apt-get07:50:210
7677998850,25cyclictest5793-21systemd-journal11:40:140
7677998650,25cyclictest6243-21apt-get08:40:150
7677998558,19cyclictest13080-21apt-get12:10:160
7677998556,19cyclictest1387-21apt-get11:35:130
7677998457,18cyclictest16944-21apt-get12:20:370
7677998456,19cyclictest6279-21apt-get10:15:280
7677998452,22cyclictest18620-21apt-get12:25:190
7677998450,24cyclictest18289-21apt-get10:50:150
7677998357,18cyclictest4560-21apt-get08:35:140
7677998356,18cyclictest2689-21apt-get10:05:140
7677998354,19cyclictest11093-21apt-get10:29:340
7677998349,24cyclictest7915-21apt-get08:45:170
7677998348,25cyclictest25071-21apt-get08:00:150
7677998347,24cyclictest520-21gdbus10:40:140
7677998345,27cyclictest30124-21apt-get09:50:170
7677998256,17cyclictest6400-21apt-get11:50:190
7677998255,20cyclictest26891-21apt-get11:15:160
7677998255,17cyclictest7780-21apt-get07:10:210
7677998254,20cyclictest8071-21apt-get11:55:190
7677998250,21cyclictest1028-21apt-get10:00:130
7677998248,22cyclictest488-21dbus-daemon10:20:160
7677998245,25cyclictest21643-21apt-get11:00:190
77812810,3sleep1201rcuc/110:19:591
7677998156,17cyclictest14590-21apt-get09:05:170
7677998154,18cyclictest16632-21apt-get10:45:170
7677998154,17cyclictest21944-21apt-get12:35:160
7677998153,20cyclictest9937-21apt-get07:15:190
7677998146,24cyclictest9756-21apt-get12:00:190
7677998145,23cyclictest13286-21apt-get10:35:230
7677998145,23cyclictest13286-21apt-get10:35:220
7677998054,17cyclictest23388-21apt-get07:55:150
7677998053,19cyclictest21795-21apt-get09:25:190
7677998051,20cyclictest23303-21apt-get11:05:150
7677998049,23cyclictest28574-21apt-get11:20:160
7677998048,23cyclictest20071-21apt-get07:45:190
7677998047,24cyclictest31783-21apt-get09:55:170
7677998046,20cyclictest28471-21apt-get09:45:210
7677998045,26cyclictest11416-21apt-get12:05:170
7677997953,19cyclictest14954-21apt-get07:30:150
7677997953,18cyclictest11234-21apt-get08:55:150
7677997951,20cyclictest11645-21apt-get07:20:300
7677997945,24cyclictest13285-21apt-get07:25:170
293162790,7sleep10-21swapper/109:45:451
7677997847,23cyclictest25222-21apt-get11:10:240
7677997847,22cyclictest11608-21apt-get10:30:250
7677997847,21cyclictest12920-21apt-get09:00:160
7677997847,20cyclictest32006-21apt-get08:20:350
7677997847,20cyclictest20279-21apt-get12:30:170
7677997846,24cyclictest4731-21apt-get11:45:140
7677997846,24cyclictest25118-21apt-get09:35:170
7677997846,22cyclictest15008-21apt-get12:15:200
7677997845,25cyclictest23466-21apt-get09:30:250
7677997745,23cyclictest18176-21apt-get09:15:150
7677997743,22cyclictest18408-21apt-get07:40:180
7677997742,22cyclictest26744-21apt-get08:05:210
7677997741,24cyclictest26804-21apt-get09:40:200
7677997651,17cyclictest9573-21apt-get08:50:160
7677997649,18cyclictest28403-21apt-get08:10:210
7677997647,21cyclictest19965-21apt-get10:55:220
7677997646,22cyclictest16513-21apt-get09:10:170
7677997646,20cyclictest1236-21apt-get08:25:170
7677997644,22cyclictest30495-21apt-get11:25:260
7677997641,25cyclictest32164-21apt-get11:30:160
7677997641,25cyclictest32164-21apt-get11:30:150
7677997543,22cyclictest2900-21apt-get08:30:170
7685997131,34cyclictest0-21swapper/110:50:321
7677997141,19cyclictest488-21dbus-daemon09:20:180
7677997136,26cyclictest0-21swapper/008:15:170
131752680,5sleep113178-21tr09:00:261
7685996647,12cyclictest30167-21date11:25:021
7685996314,32cyclictest488-21dbus-daemon12:20:181
7685996117,29cyclictest111rcu_preempt07:20:081
83792590,7sleep121-21ksoftirqd/110:20:291
768599594,16cyclictest488-21dbus-daemon08:20:201
7685995926,27cyclictest488-21dbus-daemon09:20:181
7685995924,29cyclictest488-21dbus-daemon11:40:131
768599583,16cyclictest488-21dbus-daemon08:00:201
7685995817,35cyclictest0-21swapper/110:40:161
7685995810,34cyclictest21-21ksoftirqd/111:59:171
768599579,12cyclictest21-21ksoftirqd/109:30:291
768599577,33cyclictest488-21dbus-daemon11:00:161
7685995724,28cyclictest0-21swapper/112:05:411
7685995625,25cyclictest488-21dbus-daemon08:20:031
7685995526,16cyclictest21-21ksoftirqd/110:49:541
7685995526,10cyclictest29878-21cron08:15:001
7685995523,25cyclictest3009-21latency_hist11:40:031
768599547,12cyclictest21-21ksoftirqd/108:30:261
7685995424,23cyclictest0-21swapper/111:00:031
7685995423,25cyclictest488-21dbus-daemon10:40:011
7685995423,25cyclictest488-21dbus-daemon10:40:001
7685995423,25cyclictest26607-21latency_hist09:40:031
7685995422,25cyclictest488-21dbus-daemon09:40:171
7685995422,13cyclictest5793-21systemd-journal10:00:121
7685995420,17cyclictest21-21ksoftirqd/107:26:141
85962532,9sleep18679-21uname08:45:381
7685995323,26cyclictest0-21swapper/108:26:111
7685995321,27cyclictest0-21swapper/109:15:391
768599529,9cyclictest111rcu_preempt12:35:161
768599529,8cyclictest111rcu_preempt07:16:231
768599529,15cyclictest111rcu_preempt07:54:531
768599528,11cyclictest21-21ksoftirqd/109:15:011
768599528,11cyclictest21-21ksoftirqd/108:51:191
768599528,11cyclictest21-21ksoftirqd/107:35:291
768599528,11cyclictest21-21ksoftirqd/107:35:281
768599528,10cyclictest21-21ksoftirqd/110:05:111
768599526,13cyclictest21-21ksoftirqd/110:10:191
768599526,12cyclictest21-21ksoftirqd/111:10:491
7685995236,11cyclictest21-21ksoftirqd/111:25:051
7685995233,14cyclictest14936-21seq07:30:041
7685995221,11cyclictest11804-21needreboot08:55:301
7685995219,12cyclictest488-21dbus-daemon11:20:011
7685995210,15cyclictest111rcu_preempt08:36:311
768599519,9cyclictest21-21ksoftirqd/112:15:031
768599517,11cyclictest21-21ksoftirqd/111:45:321
768599517,11cyclictest21-21ksoftirqd/107:49:011
768599516,12cyclictest21-21ksoftirqd/109:05:251
7685995133,13cyclictest8961-21seq07:11:511
7685995129,16cyclictest28218-21cron08:10:011
7685995123,21cyclictest0-21swapper/112:00:071
7685995115,18cyclictest7689-21sshd11:52:541
7685995115,17cyclictest21592-21seq12:33:121
768599509,8cyclictest111rcu_preempt09:50:271
768599508,10cyclictest21-21ksoftirqd/109:25:021
7685995013,18cyclictest12183-21snmpd11:05:031
7685995010,9cyclictest111rcu_preempt10:31:131
7685995010,20cyclictest21-21ksoftirqd/110:25:531
323142500,5sleep1768599cyclictest09:55:291
768599496,11cyclictest21-21ksoftirqd/111:30:151
768599496,11cyclictest21-21ksoftirqd/111:30:141
7685994913,18cyclictest18620-21apt-get12:25:161
7685994811,19cyclictest21-21ksoftirqd/107:56:361
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:123
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
none17:13:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional