You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-02 - 10:50

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.19.8-rt6 (Profile)

Latency plot of system in rack #4, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the alll highest latencies:
System rack4slot0.osadl.org (updated Sat Jul 02, 2022 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
327652870,0sleep00-21swapper/023:17:080
33092810,1sleep3401ktimersoftd/322:16:423
143392810,1sleep00-21swapper/000:00:000
192332780,1sleep3391rcuc/322:04:133
120092770,0sleep00-21swapper/022:53:380
164222730,0sleep20-21swapper/221:58:422
310312720,1sleep231029-21sshd22:15:582
202182700,1sleep220217-21id21:17:072
202182700,1sleep220217-21id21:17:072
230692650,0sleep10-21swapper/122:45:151
190952600,0sleep20-21swapper/221:13:062
190952600,0sleep20-21swapper/221:13:052
199102580,3sleep2894099cyclictest23:50:322
854625726,9sleep10-21swapper/119:07:531
758525522,26sleep20-21swapper/219:05:172
865925422,9sleep00-21swapper/019:08:570
256622520,2sleep1893399cyclictest00:24:251
20412510,0sleep10-21swapper/121:22:541
110712490,0sleep20-21swapper/221:24:032
262082450,0sleep00-21swapper/023:21:090
840824328,9sleep30-21swapper/319:06:433
8944993736,0cyclictest102550irq/24-eno121:49:253
893399338,24cyclictest3740-21kworker/1:021:49:251
20332330,0sleep10-21swapper/121:41:151
191452330,1sleep019137-21bash21:49:030
167262320,0sleep10-21swapper/123:29:511
8940992811,1cyclictest25840-21nfsd00:17:422
89702250,1sleep3391rcuc/323:03:153
894099241,1cyclictest1060-21sshd21:41:062
894099240,3cyclictest0-21swapper/220:30:162
892799240,1cyclictest14787-21sshd22:23:400
894099235,1cyclictest0-21swapper/200:37:332
894099235,1cyclictest0-21swapper/200:37:332
894099230,2cyclictest31781-21sshd22:21:112
270752230,0sleep30-21swapper/322:10:223
894499220,4cyclictest0-21swapper/322:24:503
894099222,2cyclictest29672-21lspci21:35:252
894099220,4cyclictest0-21swapper/220:59:242
894099220,4cyclictest0-21swapper/220:40:372
894099220,4cyclictest0-21swapper/220:17:142
894099220,1cyclictest0-21swapper/222:39:112
894099220,1cyclictest0-21swapper/221:54:092
894099220,1cyclictest0-21swapper/221:47:522
894099220,1cyclictest0-21swapper/220:00:002
894099220,1cyclictest0-21swapper/200:07:492
893399222,2cyclictest0-21swapper/121:10:321
893399222,2cyclictest0-21swapper/121:10:321
892799220,4cyclictest0-21swapper/019:32:330
31052220,0sleep1241ktimersoftd/122:21:461
294032220,1sleep029392-21sshd22:35:550
269962220,1sleep227000-21unixbench_multi19:50:202
256942220,1sleep125689-21bash23:00:461
210262220,0sleep20-21swapper/223:15:172
119092220,0sleep30-21swapper/323:24:003
8940992111,2cyclictest593-21systemd-journal22:26:462
8940992111,2cyclictest593-21systemd-journal22:26:462
894099210,3cyclictest28009-21grep22:30:362
894099210,3cyclictest0-21swapper/223:30:092
894099210,3cyclictest0-21swapper/220:26:322
894099210,3cyclictest0-21swapper/200:21:562
894099210,1cyclictest0-21swapper/223:55:372
894099210,1cyclictest0-21swapper/223:00:002
893399212,2cyclictest0-21swapper/123:42:591
893399211,2cyclictest0-21swapper/123:39:361
893399211,2cyclictest0-21swapper/121:54:471
893399210,3cyclictest0-21swapper/120:37:161
892799211,2cyclictest14682-21sshd23:54:550
892799210,4cyclictest0-21swapper/020:56:200
892799210,3cyclictest0-21swapper/023:42:080
892799210,3cyclictest0-21swapper/022:28:210
892799210,3cyclictest0-21swapper/022:28:210
892799210,3cyclictest0-21swapper/019:17:230
253112210,1sleep2321ktimersoftd/223:36:142
252972210,1sleep233-21ksoftirqd/200:30:002
894099203,2cyclictest0-21swapper/220:20:142
894099200,2cyclictest0-21swapper/219:46:152
894099200,1cyclictest0-21swapper/222:41:432
894099200,1cyclictest0-21swapper/221:33:312
894099200,1cyclictest0-21swapper/220:50:142
894099200,1cyclictest0-21swapper/220:00:592
894099200,1cyclictest0-21swapper/219:26:412
893399203,2cyclictest0-21swapper/122:06:231
893399202,2cyclictest0-21swapper/120:20:011
893399201,2cyclictest0-21swapper/120:22:241
893399200,2cyclictest27546-21lspci23:21:211
893399200,2cyclictest13802-21sshd23:54:471
893399200,2cyclictest0-21swapper/120:04:571
892799202,2cyclictest17189-21sshd23:09:400
892799200,3cyclictest0-21swapper/022:05:400
892799200,3cyclictest0-21swapper/000:27:030
892799200,2cyclictest0-21swapper/023:13:310
892799200,2cyclictest0-21swapper/019:23:250
892799200,2cyclictest0-21swapper/000:10:040
892799200,1cyclictest0-21swapper/021:40:140
245702200,1sleep00-21swapper/023:25:530
8944991917,1cyclictest41-21ksoftirqd/321:34:313
894499190,3cyclictest0-21swapper/323:51:233
894099190,4cyclictest0-21swapper/223:23:032
894099190,1cyclictest0-21swapper/223:41:272
894099190,1cyclictest0-21swapper/221:28:452
894099190,1cyclictest0-21swapper/221:07:172
894099190,1cyclictest0-21swapper/220:46:062
894099190,1cyclictest0-21swapper/220:38:152
894099190,1cyclictest0-21swapper/220:14:222
894099190,1cyclictest0-21swapper/220:06:362
894099190,1cyclictest0-21swapper/219:42:572
894099190,1cyclictest0-21swapper/219:18:252
894099190,1cyclictest0-21swapper/219:11:042
894099190,1cyclictest0-21swapper/200:30:142
893399192,2cyclictest0-21swapper/122:16:191
893399192,2cyclictest0-21swapper/119:19:431
893399192,1cyclictest0-21swapper/121:06:591
893399191,2cyclictest20788-21id21:17:111
893399191,2cyclictest20788-21id21:17:111
893399190,2cyclictest0-21swapper/119:21:441
893399190,1cyclictest0-21swapper/123:31:341
893399190,1cyclictest0-21swapper/123:09:301
893399190,1cyclictest0-21swapper/122:50:151
893399190,1cyclictest0-21swapper/122:43:331
893399190,1cyclictest0-21swapper/122:36:141
893399190,1cyclictest0-21swapper/121:36:271
893399190,1cyclictest0-21swapper/121:25:301
893399190,1cyclictest0-21swapper/120:31:491
893399190,1cyclictest0-21swapper/120:07:401
893399190,1cyclictest0-21swapper/119:58:351
892799190,4cyclictest0-21swapper/019:41:450
892799190,1cyclictest0-21swapper/023:36:310
892799190,1cyclictest0-21swapper/022:55:480
892799190,1cyclictest0-21swapper/022:45:560
892799190,1cyclictest0-21swapper/022:41:270
892799190,1cyclictest0-21swapper/022:33:330
892799190,1cyclictest0-21swapper/021:30:120
892799190,1cyclictest0-21swapper/020:49:420
892799190,1cyclictest0-21swapper/020:39:320
892799190,1cyclictest0-21swapper/020:30:040
892799190,1cyclictest0-21swapper/020:27:410
892799190,1cyclictest0-21swapper/020:20:130
892799190,1cyclictest0-21swapper/020:05:460
892799190,1cyclictest0-21swapper/019:54:500
892799190,1cyclictest0-21swapper/019:35:130
892799190,1cyclictest0-21swapper/019:12:480
892799190,1cyclictest0-21swapper/000:34:300
892799190,1cyclictest0-21swapper/000:06:110
892799190,1cyclictest0-21swapper/000:00:390
25382190,0sleep00-21swapper/021:11:040
25382190,0sleep00-21swapper/021:11:030
217842190,0sleep20-21swapper/222:09:412
894499183,14cyclictest10789-21sshd21:12:053
894499183,14cyclictest10789-21sshd21:12:053
894499181,2cyclictest0-21swapper/300:09:403
894499180,4cyclictest0-21swapper/300:10:213
894499180,3cyclictest0-21swapper/323:30:333
894499180,3cyclictest0-21swapper/321:42:273
894499180,3cyclictest0-21swapper/320:25:073
894499180,3cyclictest0-21swapper/320:04:463
894499180,2cyclictest0-21swapper/322:49:303
894499180,2cyclictest0-21swapper/300:39:443
894499180,2cyclictest0-21swapper/300:39:443
894099180,3cyclictest0-21swapper/223:45:502
894099180,1cyclictest0-21swapper/223:09:362
893399183,1cyclictest0-21swapper/120:46:361
893399181,2cyclictest29637-21grepconf.sh22:10:461
893399180,1cyclictest27143-21sshd22:00:201
893399180,0cyclictest0-21swapper/123:55:131
893399180,0cyclictest0-21swapper/122:56:321
893399180,0cyclictest0-21swapper/121:03:581
893399180,0cyclictest0-21swapper/119:51:001
893399180,0cyclictest0-21swapper/119:29:091
893399180,0cyclictest0-21swapper/100:26:511
892799180,3cyclictest0-21swapper/019:47:020
892799180,2cyclictest7898-21sshd21:15:340
892799180,2cyclictest7898-21sshd21:15:330
892799180,2cyclictest7429-21lspci22:17:220
892799180,1cyclictest17541-21sshd21:53:490
892799180,1cyclictest0-21swapper/021:58:460
892799180,1cyclictest0-21swapper/020:51:430
892799180,1cyclictest0-21swapper/000:22:410
892799180,17cyclictest0-21swapper/022:01:280
894499173,2cyclictest0-21swapper/320:59:573
894499172,2cyclictest0-21swapper/323:47:053
8944991715,1cyclictest41-21ksoftirqd/321:37:073
8944991715,1cyclictest14849-21sshd00:22:273
8944991713,2cyclictest21569-21sshd00:01:083
894499170,3cyclictest0-21swapper/323:25:313
894499170,2cyclictest102550irq/24-eno121:50:473
894499170,2cyclictest0-21swapper/323:40:533
894499170,2cyclictest0-21swapper/322:56:563
894499170,2cyclictest0-21swapper/320:48:213
894499170,2cyclictest0-21swapper/319:14:023
894499170,2cyclictest0-21swapper/300:16:343
894499170,1cyclictest15847-21lspci23:09:273
894499170,1cyclictest0-21swapper/319:42:403
894499170,15cyclictest0-21swapper/319:55:103
894099170,2cyclictest0-21swapper/200:04:262
893399170,2cyclictest5176-21sshd00:32:081
893399170,2cyclictest0-21swapper/123:15:101
893399170,2cyclictest0-21swapper/100:39:181
893399170,2cyclictest0-21swapper/100:39:171
893399170,0cyclictest0-21swapper/119:49:431
892799173,2cyclictest0-21swapper/023:03:530
892799170,2cyclictest0-21swapper/000:19:050
894499162,2cyclictest30188-21bash23:36:593
894499162,0cyclictest814-21xfsaild/dm-223:10:483
894499161,2cyclictest31800-21nscd00:31:053
894499160,4cyclictest0-21swapper/323:18:433
894499160,4cyclictest0-21swapper/321:05:433
894499160,3cyclictest0-21swapper/322:05:023
894499160,1cyclictest0-21swapper/323:58:493
894499160,1cyclictest0-21swapper/322:36:263
894499160,1cyclictest0-21swapper/322:33:563
894499160,1cyclictest0-21swapper/321:56:143
894499160,1cyclictest0-21swapper/321:28:503
894499160,1cyclictest0-21swapper/321:15:353
894499160,1cyclictest0-21swapper/321:15:343
894499160,1cyclictest0-21swapper/321:00:403
894499160,1cyclictest0-21swapper/320:51:263
894499160,1cyclictest0-21swapper/320:43:423
894499160,1cyclictest0-21swapper/320:24:503
894499160,1cyclictest0-21swapper/320:16:413
894499160,1cyclictest0-21swapper/319:50:253
894499160,1cyclictest0-21swapper/319:30:523
894499160,1cyclictest0-21swapper/319:25:493
894499160,14cyclictest0-21swapper/322:25:193
894499160,14cyclictest0-21swapper/322:25:183
894099165,10cyclictest16244-21sshd23:03:212
894099160,4cyclictest0-21swapper/219:30:182
894099160,1cyclictest21723-21sshd00:12:252
894099160,1cyclictest0-21swapper/223:10:422
894099160,1cyclictest0-21swapper/222:50:202
894099160,1cyclictest0-21swapper/222:10:372
894099160,1cyclictest0-21swapper/221:01:232
894099160,1cyclictest0-21swapper/219:38:332
894099160,15cyclictest25978-21lspci22:00:132
893399161,2cyclictest0-21swapper/100:13:361
893399160,1cyclictest0-21swapper/123:48:271
893399160,1cyclictest0-21swapper/122:32:401
893399160,1cyclictest0-21swapper/120:40:061
892799160,1cyclictest0-21swapper/020:10:140
892799160,1cyclictest0-21swapper/019:27:160
8944991512,2cyclictest41-21ksoftirqd/319:20:273
894499150,2cyclictest102550irq/24-eno119:45:013
894499150,2cyclictest0-21swapper/319:15:173
894499150,2cyclictest0-21swapper/300:28:163
894499150,1cyclictest0-21swapper/322:43:533
894499150,1cyclictest0-21swapper/321:24:013
894499150,1cyclictest0-21swapper/320:30:463
894499150,1cyclictest0-21swapper/319:37:053
894499150,0cyclictest30043-21sshd22:51:233
894499150,0cyclictest0-21swapper/320:35:063
893399151,2cyclictest0-21swapper/119:34:331
893399151,1cyclictest0-21swapper/121:31:311
893399150,2cyclictest0-21swapper/121:59:461
893399150,1cyclictest0-21swapper/120:11:501
893399150,13cyclictest25835-21nfsd19:10:081
893399150,0cyclictest0-21swapper/123:14:441
893399150,0cyclictest0-21swapper/122:26:251
893399150,0cyclictest0-21swapper/122:26:241
893399150,0cyclictest0-21swapper/119:44:001
892799150,3cyclictest0-21swapper/022:14:290
892799150,3cyclictest0-21swapper/021:29:250
892799150,2cyclictest6726-21lspci23:33:220
892799150,1cyclictest0-21swapper/020:17:370
892799150,1cyclictest0-21swapper/019:58:060
8940991411,2cyclictest15191-21in:imjournal23:25:312
893399140,0cyclictest0-21swapper/120:53:391
893399140,0cyclictest0-21swapper/119:36:361
8927991412,1cyclictest31790-21nscd21:35:410
8927991411,2cyclictest22506-21bash21:21:240
892799140,2cyclictest0-21swapper/020:43:260
892799140,1cyclictest0-21swapper/021:01:230
8944991311,1cyclictest0-21swapper/320:10:003
894499130,1cyclictest0-21swapper/320:13:553
894099130,1cyclictest0-21swapper/219:23:432
893399130,1cyclictest0-21swapper/100:08:521
892799130,1cyclictest0-21swapper/023:47:200
892799130,1cyclictest0-21swapper/000:37:320
892799130,1cyclictest0-21swapper/000:37:320
894099120,2cyclictest25658-21sshd22:45:352
893399129,2cyclictest593-21systemd-journal00:02:411
893399121,2cyclictest0-21swapper/100:15:061
893399120,10cyclictest7731-21cpuspeed20:25:101
892799120,1cyclictest0-21swapper/020:00:100
892799119,1cyclictest0-21swapper/021:05:130
893399100,9cyclictest20123-21cstates20:55:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional