You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-13 - 02:07

x86 Intel Xeon E5-2650Lv2 @1700 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #6, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack6slot0.osadl.org (updated Fri Jun 03, 2022 02:52:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1406399236232,2cyclictest0-21swapper/1322:29:195
1406399236232,2cyclictest0-21swapper/1322:29:195
1405899221209,5cyclictest4303-21CPU2
1405899221209,5cyclictest4303-21CPU2
1405899213199,11cyclictest35477-21cp21:35:162
1405899213199,11cyclictest35477-21cp21:35:162
1405899212190,13cyclictest0-21swapper/1000:12:122
1405899212190,13cyclictest0-21swapper/1000:12:122
1405899211190,11cyclictest0-21swapper/1000:01:432
1405899211190,11cyclictest0-21swapper/1000:01:432
1407299210206,2cyclictest0-21swapper/1922:30:1711
1407299210206,2cyclictest0-21swapper/1922:30:1711
1407299208204,2cyclictest0-21swapper/1923:05:3711
1407299208204,2cyclictest0-21swapper/1923:05:3711
1407299208204,2cyclictest0-21swapper/1923:05:3711
1405899207197,5cyclictest4299-21CPU2
1405899206193,6cyclictest4300-21CPU2
1405899206193,6cyclictest4300-21CPU2
1405899204197,5cyclictest0-21swapper/1023:13:162
1405899204197,5cyclictest0-21swapper/1023:13:162
1405899204185,11cyclictest0-21swapper/1021:56:522
1405899204185,11cyclictest0-21swapper/1021:56:522
1405899204185,11cyclictest0-21swapper/1021:56:522
1405899203194,6cyclictest0-21swapper/1023:32:042
1405899203194,6cyclictest0-21swapper/1023:32:042
1405899203192,6cyclictest4298-21CPU2
1405899203192,6cyclictest4298-21CPU2
1405899203192,6cyclictest19424-21CPU2
1405899203192,6cyclictest19424-21CPU2
14074992021,158cyclictest0-21swapper/2023:36:5213
14074992021,158cyclictest0-21swapper/2023:36:5213
1405899202194,5cyclictest18709-21rs:main2
1405899202194,5cyclictest18709-21rs:main2
1405899202192,7cyclictest0-21swapper/1022:45:512
1405899202192,7cyclictest0-21swapper/1022:45:512
1405899202190,9cyclictest12534-21polkitd21:26:302
1405899202190,9cyclictest12534-21polkitd21:26:302
1405899201194,5cyclictest0-21swapper/1000:37:112
1405899201194,5cyclictest0-21swapper/1000:37:112
1405899201194,5cyclictest0-21swapper/1000:37:112
1405899201183,16cyclictest0-21swapper/1022:43:302
1405899201183,16cyclictest0-21swapper/1022:43:302
1405899201183,16cyclictest0-21swapper/1022:43:302
14075992000,166cyclictest34319-21sshd22:29:5314
14075992000,166cyclictest34319-21sshd22:29:5314
14074992001,136cyclictest0-21swapper/2019:40:1513
1405899200193,5cyclictest0-21swapper/1022:53:442
1405899200193,5cyclictest0-21swapper/1022:53:442
1405899200193,5cyclictest0-21swapper/1022:53:442
1405899200191,4cyclictest4301-21CPU2
1405899200191,4cyclictest4301-21CPU2
1405899199192,5cyclictest0-21swapper/1021:45:182
1405899199192,5cyclictest0-21swapper/1021:45:182
1405899199190,6cyclictest19316-21qemu-system-x8623:56:032
1405899199190,6cyclictest19316-21qemu-system-x8623:56:032
1405899199189,5cyclictest19424-21CPU2
1405899199189,5cyclictest19424-21CPU2
14074991981,156cyclictest0-21swapper/2022:39:2113
14074991981,156cyclictest0-21swapper/2022:39:2113
1405899198193,3cyclictest0-21swapper/1023:54:012
1405899198193,3cyclictest0-21swapper/1023:54:012
1405899198193,3cyclictest0-21swapper/1023:26:252
1405899198193,3cyclictest0-21swapper/1023:26:252
1405899198193,3cyclictest0-21swapper/1023:26:252
1405899198189,6cyclictest0-21swapper/1020:35:222
1405899198189,6cyclictest0-21swapper/1020:35:212
1405899197188,6cyclictest10371-21bash22:27:482
1405899197188,6cyclictest10371-21bash22:27:482
1405899196190,4cyclictest0-21swapper/1023:22:412
1405899196190,4cyclictest0-21swapper/1023:22:412
1405899196189,5cyclictest0-21swapper/1021:13:512
1405899196189,5cyclictest0-21swapper/1021:13:512
1405899196189,4cyclictest0-21swapper/1000:34:292
1405899196189,4cyclictest0-21swapper/1000:34:292
1405899196188,6cyclictest0-21swapper/1000:30:002
1405899196188,6cyclictest0-21swapper/1000:30:002
1405899196188,6cyclictest0-21swapper/1000:25:042
1405899196188,6cyclictest0-21swapper/1000:25:042
1405899196187,6cyclictest0-21swapper/1022:30:252
1405899196187,6cyclictest0-21swapper/1022:30:252
14074991951,155cyclictest0-21swapper/2000:37:4313
14074991951,155cyclictest0-21swapper/2000:37:4313
14074991951,155cyclictest0-21swapper/2000:37:4313
1405899195188,5cyclictest0-21swapper/1021:19:352
1405899195188,5cyclictest0-21swapper/1021:19:352
1405899195188,4cyclictest0-21swapper/1021:00:122
1405899195188,4cyclictest0-21swapper/1021:00:122
1405899195187,5cyclictest0-21swapper/1022:15:522
1405899195187,5cyclictest0-21swapper/1022:15:522
1405899195186,6cyclictest0-21swapper/1022:58:332
1405899195186,6cyclictest0-21swapper/1022:58:332
1405899195186,6cyclictest0-21swapper/1022:58:332
1405899195178,14cyclictest0-21swapper/1023:00:142
1405899195178,14cyclictest0-21swapper/1023:00:142
1405899195178,10cyclictest0-21swapper/1023:06:532
1405899195178,10cyclictest0-21swapper/1023:06:532
1405899195178,10cyclictest0-21swapper/1023:06:532
1406099194187,3cyclictest0-21swapper/1200:06:134
1406099194187,3cyclictest0-21swapper/1200:06:134
1405899194188,3cyclictest19429-21CPU2
1405899194188,3cyclictest19429-21CPU2
1405899194187,5cyclictest0-21swapper/1021:41:332
1405899194187,5cyclictest0-21swapper/1021:41:332
1405899194187,4cyclictest12534-21polkitd22:06:272
1405899194187,4cyclictest12534-21polkitd22:06:272
1405899194185,6cyclictest0-21swapper/1023:43:452
1405899194185,6cyclictest0-21swapper/1023:43:452
140699919382,106cyclictest0-21swapper/1700:05:009
140699919382,106cyclictest0-21swapper/1700:05:009
14060991930,159cyclictest40288-21sshd22:07:434
14060991930,159cyclictest40288-21sshd22:07:434
1405899193187,4cyclictest0-21swapper/1023:19:062
1405899193187,4cyclictest0-21swapper/1023:19:062
1405899193186,5cyclictest0-21swapper/1022:10:342
1405899193186,5cyclictest0-21swapper/1022:10:342
1405899193184,7cyclictest0-21swapper/1023:36:312
1405899193184,7cyclictest0-21swapper/1023:36:312
1405899193183,7cyclictest0-21swapper/1019:16:072
1405899193183,7cyclictest0-21swapper/1019:16:072
14074991921,140cyclictest0-21swapper/2023:47:2313
14074991921,140cyclictest0-21swapper/2023:47:2313
1405899192182,6cyclictest0-21swapper/1021:10:002
1405899192182,6cyclictest0-21swapper/1021:10:002
140699919156,53cyclictest0-21swapper/1700:20:149
140699919156,53cyclictest0-21swapper/1700:20:149
140699919144,142cyclictest0-21swapper/1700:17:339
140699919144,142cyclictest0-21swapper/1700:17:339
1405899191184,5cyclictest0-21swapper/1020:05:042
1405899191184,5cyclictest0-21swapper/1020:05:042
1405899191182,6cyclictest0-21swapper/1021:51:032
1405899191182,6cyclictest0-21swapper/1021:51:032
1405899191181,6cyclictest4300-21CPU2
1405899191181,6cyclictest4300-21CPU2
1405899191172,16cyclictest0-21swapper/1019:20:142
1405899191172,16cyclictest0-21swapper/1019:20:142
1406399190187,1cyclictest0-21swapper/1300:10:305
1406399190187,1cyclictest0-21swapper/1300:10:295
1405899190183,5cyclictest0-21swapper/1020:30:152
1405899190183,5cyclictest0-21swapper/1020:30:152
1405899190180,7cyclictest0-21swapper/1022:35:362
1405899190180,7cyclictest0-21swapper/1022:35:362
140699918979,105cyclictest0-21swapper/1721:10:009
140699918979,105cyclictest0-21swapper/1721:10:009
140699918926,62cyclictest0-21swapper/1722:40:219
140699918926,62cyclictest0-21swapper/1722:40:219
140699918926,62cyclictest0-21swapper/1722:40:219
1405899189183,4cyclictest0-21swapper/1020:07:142
1405899189183,4cyclictest0-21swapper/1020:07:142
3003221880,3sleep251408199cyclictest23:17:2818
3003221880,3sleep251408199cyclictest23:17:2718
2538221880,4sleep371409899cyclictest23:45:4931
2538221880,4sleep371409899cyclictest23:45:4931
14074991881,149cyclictest0-21swapper/2021:14:5213
14074991881,149cyclictest0-21swapper/2021:14:5213
1405899188182,4cyclictest0-21swapper/1019:38:392
1405899188182,4cyclictest0-21swapper/1019:38:392
1405899188178,4cyclictest0-21swapper/1019:25:202
1405899188178,4cyclictest0-21swapper/1019:25:202
14074991871,142cyclictest1531-21gdbus22:53:3713
14074991871,142cyclictest1531-21gdbus22:53:3713
14074991871,142cyclictest1531-21gdbus22:53:3713
14074991870,2cyclictest0-21swapper/2019:15:5613
14074991870,2cyclictest0-21swapper/2019:15:5613
14074991870,138cyclictest13893-21sh23:10:0113
14074991870,138cyclictest13893-21sh23:10:0113
14074991870,138cyclictest13893-21sh23:10:0113
140699918730,110cyclictest0-21swapper/1721:00:129
140699918730,110cyclictest0-21swapper/1721:00:129
1405899187178,4cyclictest4298-21CPU2
1405899187178,4cyclictest4298-21CPU2
1405899187177,6cyclictest0-21swapper/1020:25:002
1408399186173,10cyclictest0-21swapper/2721:10:1820
1408399186173,10cyclictest0-21swapper/2721:10:1820
140699918649,56cyclictest0-21swapper/1723:55:219
140699918649,56cyclictest0-21swapper/1723:55:219
14060991861,2cyclictest0-21swapper/1221:48:274
14060991861,2cyclictest0-21swapper/1221:48:274
1405899186179,5cyclictest0-21swapper/1020:42:042
1405899186179,5cyclictest0-21swapper/1020:42:042
14074991851,154cyclictest0-21swapper/2023:58:2713
14074991851,154cyclictest0-21swapper/2023:58:2713
1405899185179,4cyclictest0-21swapper/1020:51:282
1405899185179,4cyclictest0-21swapper/1020:51:282
14074991841,140cyclictest0-21swapper/2021:50:1213
14074991841,140cyclictest0-21swapper/2021:50:1213
14074991841,139cyclictest0-21swapper/2021:27:5213
14074991841,139cyclictest0-21swapper/2021:27:5213
14074991840,1cyclictest0-21swapper/2021:35:2013
14074991840,1cyclictest0-21swapper/2021:35:2013
1405899184178,4cyclictest0-21swapper/1020:10:162
1405899184178,4cyclictest0-21swapper/1020:10:152
1405899184178,4cyclictest0-21swapper/1019:51:022
1405899184178,4cyclictest0-21swapper/1019:51:012
14074991831,149cyclictest0-21swapper/2000:03:4813
14074991831,149cyclictest0-21swapper/2000:03:4813
14074991831,141cyclictest0-21swapper/2022:11:5113
14074991831,141cyclictest0-21swapper/2022:11:5113
14074991831,140cyclictest0-21swapper/2021:24:2013
14074991831,140cyclictest0-21swapper/2021:24:2013
140699918339,61cyclictest0-21swapper/1722:40:019
140699918339,61cyclictest0-21swapper/1722:40:019
1405899183177,4cyclictest0-21swapper/1019:55:122
1405899183177,4cyclictest0-21swapper/1019:55:122
1405899183177,4cyclictest0-21swapper/1019:49:232
1405899183177,4cyclictest0-21swapper/1019:40:162
14082991820,178cyclictest17567-21sshd23:00:2619
14082991820,178cyclictest17567-21sshd23:00:2619
14074991827,127cyclictest753-21systemd-journal00:06:4313
14074991827,127cyclictest753-21systemd-journal00:06:4313
14074991821,135cyclictest0-21swapper/2022:25:1313
14074991821,135cyclictest0-21swapper/2022:25:1313
140699918250,125cyclictest4299-21CPU9
140699918250,125cyclictest4299-21CPU9
140699918237,142cyclictest0-21swapper/1721:10:289
140699918237,142cyclictest0-21swapper/1721:10:289
1405899182176,4cyclictest0-21swapper/1020:25:392
1405899182174,5cyclictest0-21swapper/1020:58:392
1405899182174,5cyclictest0-21swapper/1020:58:392
404221810,3sleep161406899cyclictest22:33:448
404221810,3sleep161406899cyclictest22:33:448
14080991811,176cyclictest2439-21sshd22:59:3017
14080991811,176cyclictest2439-21sshd22:59:3017
14080991811,176cyclictest2439-21sshd22:59:3017
14074991811,148cyclictest0-21swapper/2023:10:3913
14074991811,148cyclictest0-21swapper/2023:10:3913
556021800,3sleep261408299cyclictest21:23:3019
556021800,3sleep261408299cyclictest21:23:3019
2389321800,5sleep381410099cyclictest00:27:2432
2389321800,5sleep381410099cyclictest00:27:2432
1407299180176,2cyclictest0-21swapper/1900:08:5211
1407299180176,2cyclictest0-21swapper/1900:08:5211
1406999180131,46cyclictest0-21swapper/1721:18:199
1406999180131,46cyclictest0-21swapper/1721:18:199
1410299179176,1cyclictest0-21swapper/3921:32:0733
1410299179176,1cyclictest0-21swapper/3921:32:0733
14074991791,147cyclictest0-21swapper/2022:48:5913
14074991791,147cyclictest0-21swapper/2022:48:5913
140549917966,86cyclictest0-21swapper/722:20:3637
140549917966,86cyclictest0-21swapper/722:20:3637
14082991781,167cyclictest39789-21sshd00:19:2219
14082991781,167cyclictest39789-21sshd00:19:2219
14075991780,156cyclictest20923-21sshd22:19:0914
14075991780,156cyclictest20923-21sshd22:19:0914
14074991788,133cyclictest10984-21sshd21:30:1413
14074991788,133cyclictest10984-21sshd21:30:1413
14074991781,152cyclictest0-21swapper/2022:31:4313
14074991781,152cyclictest0-21swapper/2022:31:4313
14074991781,147cyclictest0-21swapper/2022:19:4113
14074991781,147cyclictest0-21swapper/2022:19:4113
14075991777,145cyclictest12682-21gdbus23:16:0514
14075991777,145cyclictest12682-21gdbus23:16:0514
14075991770,174cyclictest6472-21sshd00:22:5514
14075991770,174cyclictest6472-21sshd00:22:5514
140749917791,78cyclictest1819-21sshd00:12:1213
140749917791,78cyclictest1819-21sshd00:12:1213
14074991771,151cyclictest0-21swapper/2000:25:5713
14074991771,151cyclictest0-21swapper/2000:25:5713
14074991771,133cyclictest0-21swapper/2022:40:2013
14074991771,133cyclictest0-21swapper/2022:40:2013
14074991771,133cyclictest0-21swapper/2022:40:2013
14060991770,174cyclictest36708-21sshd22:49:094
14060991770,174cyclictest36708-21sshd22:49:094
14080991760,171cyclictest8373-21sshd00:10:1717
14080991760,171cyclictest8373-21sshd00:10:1717
14076991761,172cyclictest16599-21systemd00:01:1015
14076991761,172cyclictest16599-21systemd00:01:1015
1407299176173,1cyclictest0-21swapper/1923:52:1311
1407299176173,1cyclictest0-21swapper/1923:52:1311
140699917651,112cyclictest0-21swapper/1722:30:019
140699917651,112cyclictest0-21swapper/1722:30:019
140699917650,57cyclictest0-21swapper/1721:48:239
140699917650,57cyclictest0-21swapper/1721:48:239
140699917640,133cyclictest0-21swapper/1722:22:129
140699917640,133cyclictest0-21swapper/1722:22:119
140699917628,141cyclictest0-21swapper/1700:37:399
140699917628,141cyclictest0-21swapper/1700:37:399
140699917628,141cyclictest0-21swapper/1700:37:399
140599917654,85cyclictest0-21swapper/1123:37:183
140599917654,85cyclictest0-21swapper/1123:37:183
14082991750,169cyclictest33434-21sshd23:24:1919
14082991750,169cyclictest33434-21sshd23:24:1919
14080991750,172cyclictest34819-21sshd22:48:5817
14080991750,172cyclictest34819-21sshd22:48:5817
14080991750,172cyclictest2096-21sshd21:13:4817
14080991750,172cyclictest2096-21sshd21:13:4817
14074991758,140cyclictest5297-21sshd22:01:4013
14074991751,155cyclictest28671-21sshd21:40:5713
14074991751,155cyclictest28671-21sshd21:40:5713
14074991751,152cyclictest0-21swapper/2022:59:1613
14074991751,152cyclictest0-21swapper/2022:59:1613
14074991751,152cyclictest0-21swapper/2022:59:1613
140699917550,123cyclictest0-21swapper/1722:33:129
140699917550,123cyclictest0-21swapper/1722:33:129
14060991750,172cyclictest2762-21sshd00:19:404
14060991750,172cyclictest2762-21sshd00:19:404
14059991750,170cyclictest0-21swapper/1119:40:163
1090421750,4sleep281408499cyclictest21:17:3021
1090421750,4sleep281408499cyclictest21:17:3021
14074991747,127cyclictest1531-21gdbus23:33:3913
14074991747,127cyclictest1531-21gdbus23:33:3913
14074991746,131cyclictest29495-21sshd23:52:4813
14074991746,131cyclictest29495-21sshd23:52:4813
14074991741,169cyclictest0-21swapper/2020:25:2013
14074991740,2cyclictest0-21swapper/2022:22:4113
14074991740,2cyclictest0-21swapper/2022:22:4113
14074991740,1cyclictest0-21swapper/2019:27:1513
14074991740,1cyclictest0-21swapper/2019:27:1513
140699917445,125cyclictest0-21swapper/1723:00:119
140699917445,125cyclictest0-21swapper/1723:00:119
14076991734,131cyclictest0-21swapper/2222:36:3015
14076991734,131cyclictest0-21swapper/2222:36:2915
14074991731,144cyclictest0-21swapper/2019:20:1313
14074991731,144cyclictest0-21swapper/2019:20:1313
14074991731,141cyclictest0-21swapper/2022:07:1713
14074991731,141cyclictest0-21swapper/2022:07:1713
1407299173169,2cyclictest0-21swapper/1921:05:0111
1407299173169,2cyclictest0-21swapper/1921:05:0111
140699917357,111cyclictest19322-21CPU9
140699917357,111cyclictest19322-21CPU9
140699917340,124cyclictest0-21swapper/1722:18:179
140699917340,124cyclictest0-21swapper/1722:18:179
14060991730,169cyclictest40027-21sshd23:53:424
14060991730,169cyclictest40027-21sshd23:53:424
1334721730,3sleep371409899cyclictest22:11:5831
1334721730,3sleep371409899cyclictest22:11:5831
14076991720,168cyclictest24337-21sshd22:29:0115
14076991720,168cyclictest24337-21sshd22:29:0115
14075991721,141cyclictest40079-21systemd21:45:1514
14075991721,141cyclictest40079-21systemd21:45:1514
14074991721,147cyclictest0-21swapper/2021:55:1513
14074991721,147cyclictest0-21swapper/2021:55:1513
14074991721,147cyclictest0-21swapper/2021:55:1513
140699917253,82cyclictest0-21swapper/1700:09:179
140699917253,82cyclictest0-21swapper/1700:09:179
140699917249,119cyclictest0-21swapper/1720:08:129
140699917249,119cyclictest0-21swapper/1720:08:119
1406999172120,49cyclictest0-21swapper/1719:14:329
1406999172120,49cyclictest0-21swapper/1719:14:329
14060991721,162cyclictest12794-21sshd23:29:034
14060991721,162cyclictest12794-21sshd23:29:034
14060991721,162cyclictest12794-21sshd23:29:034
14080991710,168cyclictest20179-21sshd22:41:0617
14080991710,168cyclictest20179-21sshd22:41:0617
14080991710,168cyclictest20179-21sshd22:41:0617
14075991710,168cyclictest29277-21sshd00:11:5414
14075991710,168cyclictest29277-21sshd00:11:5414
14074991715,130cyclictest19321-21CPU13
14074991715,130cyclictest19321-21CPU13
14074991711,3cyclictest1326-21dbus-daemon23:21:3213
14074991711,3cyclictest1326-21dbus-daemon23:21:3213
14074991711,135cyclictest0-21swapper/2021:16:0813
14074991711,135cyclictest0-21swapper/2021:16:0813
140599917161,81cyclictest0-21swapper/1122:00:363
14080991700,167cyclictest23694-21sshd23:04:2317
14080991700,167cyclictest23694-21sshd23:04:2317
14080991700,166cyclictest14347-21sshd23:38:4517
14080991700,166cyclictest14347-21sshd23:38:4517
14075991700,166cyclictest24909-21sshd22:54:4414
14075991700,166cyclictest24909-21sshd22:54:4414
14075991700,166cyclictest24909-21sshd22:54:4314
14074991701,144cyclictest0-21swapper/2019:10:3413
14074991701,144cyclictest0-21swapper/2019:10:3413
140699917046,118cyclictest0-21swapper/1723:44:279
140699917046,118cyclictest0-21swapper/1723:44:279
14059991706,161cyclictest0-21swapper/1119:20:213
14059991706,161cyclictest0-21swapper/1119:20:213
140599917050,60cyclictest0-21swapper/1122:52:133
140599917050,60cyclictest0-21swapper/1122:52:133
140599917050,60cyclictest0-21swapper/1122:52:133
140599917049,103cyclictest0-21swapper/1123:28:083
140599917049,103cyclictest0-21swapper/1123:28:083
140599917049,103cyclictest0-21swapper/1123:28:083
140599917046,86cyclictest0-21swapper/1121:31:043
140599917046,86cyclictest0-21swapper/1121:31:043
1410099169126,39cyclictest0-21swapper/3821:45:1832
1410099169126,39cyclictest0-21swapper/3821:45:1832
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional