You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-05-17 - 23:21

x86 Intel Core i5-8265UE @1600 MHz, Linux 5.10.41-rt42 (Profile)

Latency plot of system in rack #a, slot #8
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackaslot8.osadl.org (updated Tue May 17, 2022 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
225342305275,19sleep20-21swapper/207:09:082
223532305274,21sleep10-21swapper/107:06:501
224842276245,21sleep00-21swapper/007:08:290
223202272223,38sleep30-21swapper/307:06:243
165952720,0sleep20-21swapper/208:05:012
93872670,4sleep00-21swapper/011:27:370
111862640,0sleep20-21swapper/211:29:302
255232610,0sleep30-21swapper/311:16:153
137632610,0sleep10-21swapper/111:30:231
74602590,0sleep30-21swapper/312:11:093
32092580,0sleep00-21swapper/011:46:060
129772540,0sleep00-21swapper/010:45:130
120402480,0sleep30-21swapper/311:53:183
71952170,0sleep10-21swapper/109:54:001
92732160,0sleep00-21swapper/012:12:340
73042160,0sleep30-21swapper/312:31:103
298042150,0sleep329803-21ssh10:33:343
2273199152,10cyclictest7291-21ssh11:25:383
2273199141,10cyclictest30059-21ssh09:45:423
2273199140,2cyclictest7196-21ssh11:04:443
2273199140,11cyclictest25477-21ssh10:54:323
2273199132,8cyclictest30074-21ssh12:05:233
2273199131,8cyclictest22763-21wc12:00:233
2273199130,1cyclictest16483-21ssh09:35:343
2273199130,10cyclictest19549-21ssh10:03:053
2273199130,10cyclictest11856-21ssh10:44:263
2273199130,0cyclictest11032-21ssh09:56:033
165432130,0sleep10-21swapper/109:11:541
162892130,0sleep20-21swapper/211:32:472
2273199122,7cyclictest21270-21sh11:35:393
2273199121,6cyclictest3781-21ssh11:24:203
2273199121,6cyclictest14124-21ssh11:30:393
2273199120,8cyclictest31712-21ssh10:11:193
2273199120,8cyclictest16170-21ssh12:36:483
2273199120,8cyclictest15696-21ssh12:16:173
2273199120,7cyclictest32360-21ssh10:59:203
2273199120,7cyclictest11029-21ssh11:06:353
128812120,0sleep20-21swapper/209:33:412
2273199111,1cyclictest7420-21apt-get07:45:023
2273199110,7cyclictest7176-21ssh10:17:023
2273199110,7cyclictest27517-21ssh10:09:073
2273199110,7cyclictest22088-21ssh10:27:503
2273199110,7cyclictest21232-21ssh09:40:033
2273199110,7cyclictest16506-21ssh10:24:153
2273199110,7cyclictest14879-21ssh10:45:413
2273199110,6cyclictest17532-21ssh09:12:563
2273199110,3cyclictest16166-21ssh11:55:313
2273199110,2cyclictest22754-21ssh09:16:263
2273199110,1cyclictest28996-21ssh09:21:023
2273199110,1cyclictest26222-21ssh11:40:053
2273199110,1cyclictest22823-21ssh12:20:303
2273199110,1cyclictest12207-21ssh09:33:003
2273199110,0cyclictest31690-21apt-get10:35:113
2272499112,6cyclictest4084-21ssh12:09:531
2272499112,6cyclictest29401-21ssh12:25:251
2272499112,6cyclictest12950-21diskmemload09:47:341
214292110,0sleep00-21swapper/009:15:210
325462100,0sleep228-21ksoftirqd/211:20:582
2273199103,6cyclictest16597-21snmpd07:13:543
2273199101,8cyclictest32284-21apt-get08:40:123
2273199100,9cyclictest283-21systemd-journal08:30:003
2273199100,8cyclictest283-21systemd-journal07:15:143
2273199100,6cyclictest4482-21ssh09:51:053
2273199100,6cyclictest18401-21chrt08:07:383
2273199100,2cyclictest6112-21run-parts07:40:193
2273199100,2cyclictest3254-21sh11:46:093
2273199100,1cyclictest585-21apt-get09:25:023
2273199100,1cyclictest29869-21ssh12:25:393
2273199100,1cyclictest16950-21ssh11:10:323
2273199100,1cyclictest10550-21sed07:50:143
2273199100,1cyclictest0-21swapper/307:35:203
2273199100,0cyclictest0-21swapper/308:50:103
2272499106,3cyclictest8065-21apt-get11:05:151
2272499103,3cyclictest8263-21ssh10:18:011
2272499102,6cyclictest15109-21ssh10:22:501
2272499102,5cyclictest8332-21ssh10:40:461
2272499102,4cyclictest27487-21rm12:24:131
2272499102,4cyclictest25746-21rm09:43:051
2272499101,6cyclictest3019-21ssh11:23:381
2272499101,4cyclictest10727-21rm12:13:451
227319992,6cyclictest19964-21processes08:10:183
227319992,6cyclictest16597-21snmpd07:59:043
227319991,7cyclictest30050-21apt07:25:003
227319991,7cyclictest23739-21df08:20:153
227319990,8cyclictest8481-21sendmail09:00:003
227319990,8cyclictest32290-21ls07:30:003
227319990,8cyclictest23100-21munin-run08:20:003
227319990,8cyclictest12943-21apt09:10:003
227319990,1cyclictest0-21swapper/309:00:193
227319990,1cyclictest0-21swapper/308:37:323
227319990,0cyclictest0-21swapper/307:30:133
227249993,5cyclictest25034-21cat07:15:011
227249992,5cyclictest24136-21sh11:38:171
227249992,5cyclictest18019-21ssh10:01:321
227249992,5cyclictest14999-21ssh10:45:501
227249992,3cyclictest8317-21cat11:50:191
227249992,3cyclictest31912-21cstates10:35:121
227249992,3cyclictest28954-21apt-get10:10:121
227249992,3cyclictest27643-21rm12:04:141
227249992,3cyclictest2094-21mailstats11:45:191
227249992,3cyclictest14105-21ssh09:59:151
227249992,3cyclictest13670-21ssh12:35:191
227249992,2cyclictest29342-21ssh09:21:211
227249992,2cyclictest20861-21munin-run08:15:011
227249992,2cyclictest12950-21diskmemload09:28:011
227249991,6cyclictest28528-21sh10:32:201
227249991,5cyclictest5140-21sh11:02:351
227249991,5cyclictest26254-21ssh11:40:071
227249991,5cyclictest25964-21ssh10:07:311
227249991,5cyclictest25306-21ssh11:16:011
227249991,3cyclictest26296-21cut07:15:141
227249991,3cyclictest12950-21diskmemload11:55:261
8408280,1sleep2281ksoftirqd/212:32:052
227319980,7cyclictest15158-21wc08:00:153
227319980,3cyclictest28304-21cut08:30:143
227319980,1cyclictest2081-21apt-get08:45:113
227289983,3cyclictest8504-21munin-run09:00:002
227249984,3cyclictest30708-21cat08:35:141
227249984,3cyclictest0-21swapper/107:30:121
227249983,4cyclictest7070-21cut07:45:001
227249983,4cyclictest18822-21ssh09:37:551
227249982,5cyclictest24058-21uname08:20:171
227249982,3cyclictest28977-21needreboot07:20:181
227249982,2cyclictest9029-21/usr/sbin/munin09:30:241
227249982,2cyclictest3984-21sshd08:49:361
227249982,2cyclictest29152-21ssh10:56:161
227249982,2cyclictest14822-21ssh12:15:351
227249982,2cyclictest10993-21ssh12:34:091
227249981,5cyclictest9074-21ssh11:27:181
227249981,5cyclictest12146-21/usr/sbin/munin07:55:171
227249981,3cyclictest9712-21ntp_offset09:00:171
227249981,3cyclictest3996-21sed07:35:201
227249981,3cyclictest32242-21taskset07:29:391
227249981,3cyclictest23260-21ssh09:16:551
227249981,3cyclictest20888-21/usr/sbin/munin10:50:231
227249981,2cyclictest19668-21ssh10:25:311
227249981,2cyclictest17928-21ssh11:11:071
227199984,2cyclictest283-21systemd-journal07:24:550
227199983,3cyclictest283-21systemd-journal10:04:540
227289976,1cyclictest28-21ksoftirqd/210:00:022
227289973,3cyclictest16597-21snmpd07:56:402
227289973,2cyclictest283-21systemd-journal11:40:172
227289971,3cyclictest18626-21dump-pmu-power08:10:002
227289970,4cyclictest11913-21munin-run07:55:002
227249974,2cyclictest9441-21sleep07:50:001
227249974,2cyclictest7772-21wc08:55:201
227249974,2cyclictest5256-21ntpq08:50:171
227249974,2cyclictest1842-21awk08:45:001
227249973,3cyclictest29286-21unixbench_multi08:30:191
227249973,3cyclictest26896-21cat08:25:191
227249973,3cyclictest21276-21cpuspeed_turbos08:15:131
227249973,3cyclictest16765-21ls08:05:121
227249973,3cyclictest14943-21gltestperf08:00:151
227249973,3cyclictest11488-21/usr/sbin/munin09:05:151
227249973,3cyclictest10148-21wc07:50:121
227199973,3cyclictest283-21systemd-journal07:55:010
227199973,3cyclictest21211-21apt-get12:00:120
227199973,3cyclictest16597-21snmpd07:45:350
227199973,1cyclictest0-21swapper/009:58:430
227199970,7cyclictest0-21swapper/008:10:010
227199970,1cyclictest20923-21ssh09:40:010
23455260,0sleep20-21swapper/212:21:012
227289966,0cyclictest0-21swapper/212:07:512
227289966,0cyclictest0-21swapper/209:15:432
227289965,1cyclictest28-21ksoftirqd/210:50:002
227289965,1cyclictest28-21ksoftirqd/208:40:002
227289964,1cyclictest18911-21pmu-power10:25:172
227289963,2cyclictest327-21in:imuxsock09:10:012
227289963,2cyclictest283-21systemd-journal11:15:082
227289963,2cyclictest2800-21taskset08:45:142
227289963,2cyclictest16597-21snmpd11:56:192
227289963,2cyclictest16597-21snmpd11:37:472
227289963,2cyclictest14647-21sh12:35:382
227289963,2cyclictest14427-21ssh09:10:302
227289963,2cyclictest13480-21ssh10:21:132
227289963,2cyclictest10963-11brltty10:02:152
227289963,1cyclictest0-21swapper/210:12:072
227289962,3cyclictest3277-21cat07:35:162
227289962,3cyclictest25395-21expr10:30:142
227289962,3cyclictest22617-21smart_sda12:00:222
227289962,3cyclictest16597-21snmpd12:10:332
227289962,3cyclictest16597-21snmpd11:48:582
227289962,3cyclictest16597-21snmpd11:11:172
227289962,3cyclictest16597-21snmpd11:06:292
227289962,3cyclictest16597-21snmpd10:05:132
227289962,3cyclictest16597-21snmpd09:51:472
227289962,3cyclictest16597-21snmpd09:27:252
227289962,3cyclictest16597-21snmpd08:51:022
227289962,3cyclictest16597-21snmpd08:40:202
227289962,3cyclictest16597-21snmpd08:32:242
227289962,3cyclictest16597-21snmpd07:29:322
227289962,3cyclictest16597-21snmpd07:18:332
227289962,3cyclictest1065-21cat07:30:172
227289962,2cyclictest283-21systemd-journal09:20:532
227289962,2cyclictest283-21systemd-journal07:49:362
227289962,1cyclictest0-21swapper/212:25:422
227289962,1cyclictest0-21swapper/212:17:452
227289962,1cyclictest0-21swapper/211:01:492
227289962,1cyclictest0-21swapper/210:15:132
227289962,1cyclictest0-21swapper/209:45:422
227289962,1cyclictest0-21swapper/209:37:352
227289961,3cyclictest283-21systemd-journal10:55:042
227289960,0cyclictest0-21swapper/210:44:502
227199964,1cyclictest23500-21cut07:10:150
227199963,2cyclictest4912-21cat08:50:140
227199963,2cyclictest32666-21ssh09:48:320
227199963,2cyclictest3239-21ssh11:00:380
227199963,2cyclictest31575-21systemctl11:20:280
227199963,2cyclictest3130-21sshd10:14:530
227199963,2cyclictest283-21systemd-journal07:35:000
227199963,2cyclictest21223-21sh11:35:370
227199963,2cyclictest20567-21taskset08:11:530
227199963,2cyclictest16597-21snmpd07:15:280
227199963,2cyclictest15087-21cat08:00:160
227199963,2cyclictest13120-21ntpq07:55:190
227199962,3cyclictest5763-21memory07:40:160
227199962,3cyclictest3819-21sensors_temp07:35:190
227199962,3cyclictest3275-21sensors_temp08:45:190
227199962,3cyclictest30417-21awk12:05:260
227199962,3cyclictest27976-21cat09:20:340
227199962,3cyclictest25525-21cat10:30:160
227199962,3cyclictest23693-21expr08:20:140
227199962,3cyclictest2014-21cat09:25:140
227199962,3cyclictest18599-21cat10:25:150
227199962,3cyclictest16597-21snmpd12:36:440
227199962,3cyclictest16597-21snmpd12:32:080
227199962,3cyclictest16597-21snmpd12:16:250
227199962,3cyclictest16597-21snmpd11:58:510
227199962,3cyclictest16597-21snmpd11:50:450
227199962,3cyclictest16597-21snmpd10:39:400
227199962,3cyclictest16597-21snmpd09:41:210
227199962,3cyclictest16597-21snmpd09:31:530
227199962,3cyclictest16597-21snmpd09:06:210
227199962,3cyclictest16597-21snmpd09:03:390
227199962,3cyclictest16597-21snmpd08:34:260
227199962,3cyclictest16597-21snmpd07:25:430
227199962,3cyclictest1141-21threads08:40:210
227199962,3cyclictest0-21swapper/011:40:090
227199962,3cyclictest0-21swapper/010:43:080
227199962,1cyclictest0-21swapper/012:25:320
227199962,1cyclictest0-21swapper/011:32:030
227199962,1cyclictest0-21swapper/010:19:550
227199961,3cyclictest283-21systemd-journal10:59:210
227199960,6cyclictest0-21swapper/012:21:400
227199960,6cyclictest0-21swapper/010:24:510
227199960,6cyclictest0-21swapper/010:07:390
227199960,0cyclictest0-21swapper/010:54:420
11199260,0sleep20-21swapper/211:52:302
227289953,1cyclictest4932-21chrt07:40:062
227289953,1cyclictest21513-21cpuspeed_turbos09:40:132
227289953,1cyclictest0-21swapper/210:35:102
227289952,2cyclictest9410-21if_enp4s009:00:152
227289952,2cyclictest29639-21users07:20:222
227289952,2cyclictest23598-21cat08:20:152
227289952,2cyclictest23450-21fw_packets07:10:142
227289952,2cyclictest19704-21cat10:50:142
227289951,3cyclictest25845-21expr08:25:132
227289951,3cyclictest21779-21cat08:15:162
227289951,3cyclictest19265-21df_inode08:10:142
227199952,2cyclictest7117-21/usr/sbin/munin08:55:150
227199952,2cyclictest25827-21expr08:25:120
227199952,2cyclictest23051-21expr11:15:120
227199952,2cyclictest2030-21chrt09:50:110
227199952,1cyclictest0-21swapper/009:10:060
227199951,3cyclictest30707-21cat08:35:140
227199951,3cyclictest21307-21cat08:15:120
227199950,4cyclictest8072-21ssh11:05:150
227199950,4cyclictest15415-21rm11:10:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional