You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-04 - 17:09

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.4.39-rt50+ (Profile)

Latency plot of system in rack #7, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack7slot0.osadl.org (updated Sun Dec 04, 2022 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117950640,0irq/26-eth1-rx-0-21swapper/307:09:263
110050620,0irq/25-eth00-21swapper/107:09:261
110050450,0irq/25-eth00-21swapper/207:09:082
117950440,0irq/26-eth1-rx-0-21swapper/007:07:130
117950270,0irq/26-eth1-rx-0-21swapper/107:10:001
891099191,0cyclictest22044-21id10:05:092
890999170,0cyclictest0-21swapper/111:53:291
8909991614,0cyclictest25549-21sshd11:55:201
110050160,0irq/25-eth00-21swapper/110:32:101
891199150,0cyclictest0-21swapper/312:25:043
8910991512,0cyclictest482-21diskmemload12:02:272
8909991513,0cyclictest22691-21sshd12:35:221
8911991413,0cyclictest10914-21sshd11:37:003
891199140,0cyclictest0-21swapper/311:17:573
8910991413,0cyclictest23104-21sshd11:11:372
8910991413,0cyclictest0-21swapper/211:06:002
8910991413,0cyclictest0-21swapper/209:31:252
8910991411,0cyclictest0-21swapper/212:14:522
891099141,0cyclictest17963-21sshd10:11:162
891099140,0cyclictest0-21swapper/211:58:432
891099140,0cyclictest0-21swapper/210:33:342
8909991413,0cyclictest18815-21sshd09:51:311
8909991411,0cyclictest20846-21sshd09:55:061
8908991413,0cyclictest0-21swapper/009:15:200
8911991312,0cyclictest0-21swapper/312:10:483
891199130,0cyclictest0-21swapper/311:59:493
891199130,0cyclictest0-21swapper/311:51:513
891199130,0cyclictest0-21swapper/310:07:043
891199130,0cyclictest0-21swapper/309:31:453
8910991312,0cyclictest0-21swapper/209:52:202
8909991313,0cyclictest0-21swapper/111:25:561
8909991312,0cyclictest29740-21sshd10:12:321
8909991312,0cyclictest19811-21sshd12:11:291
8909991311,0cyclictest0-21swapper/111:19:121
890999130,0cyclictest0-21swapper/110:44:351
890999130,0cyclictest0-21swapper/109:12:491
890899130,0cyclictest482-21diskmemload11:00:070
890899130,0cyclictest0-21swapper/012:35:230
351130,0ktimersoftd/30-21swapper/310:53:183
110050130,0irq/25-eth016606-21sshd11:34:183
8911991212,0cyclictest0-21swapper/311:02:363
8911991211,0cyclictest0-21swapper/310:45:453
8911991211,0cyclictest0-21swapper/310:26:563
8911991211,0cyclictest0-21swapper/310:10:403
8911991211,0cyclictest0-21swapper/309:27:003
8911991211,0cyclictest0-21swapper/309:22:293
8911991211,0cyclictest0-21swapper/309:17:003
891199120,0cyclictest0-21swapper/311:28:023
891199120,0cyclictest0-21swapper/310:37:313
891199120,0cyclictest0-21swapper/310:18:493
891199120,0cyclictest0-21swapper/309:46:583
891199120,0cyclictest0-21swapper/309:10:583
891199120,0cyclictest0-21swapper/308:25:143
8910991211,0cyclictest31842-21sshd09:59:322
8910991211,0cyclictest19860-21id11:24:422
8910991211,0cyclictest0-21swapper/211:47:142
8910991211,0cyclictest0-21swapper/210:17:532
8910991211,0cyclictest0-21swapper/209:42:272
8910991210,0cyclictest0-21swapper/210:54:012
891099120,0cyclictest1924-21sshd09:16:402
891099120,0cyclictest0-21swapper/209:22:082
8909991211,0cyclictest0-21swapper/111:08:101
8909991211,0cyclictest0-21swapper/110:56:121
8909991211,0cyclictest0-21swapper/109:45:481
8909991211,0cyclictest0-21swapper/109:24:191
890999120,0cyclictest482-21diskmemload12:09:381
890999120,0cyclictest0-21swapper/110:50:251
890999120,0cyclictest0-21swapper/109:15:511
8908991212,0cyclictest0-21swapper/009:05:210
8908991210,0cyclictest28484-21bash10:38:590
8908991210,0cyclictest0-21swapper/009:49:500
8908991210,0cyclictest0-21swapper/009:22:190
890899120,0cyclictest0-21swapper/012:01:130
890899120,0cyclictest0-21swapper/010:03:390
41120,0ktimersoftd/021833-21id09:51:480
117950120,0irq/26-eth1-rx-0-21swapper/011:42:510
110050120,0irq/25-eth09058-21sshd10:07:041
110050120,0irq/25-eth00-21swapper/109:25:081
8911991111,0cyclictest0-21swapper/307:45:143
8911991111,0cyclictest0-21swapper/307:35:223
8911991110,0cyclictest15574-21sshd09:51:093
8911991110,0cyclictest0-21swapper/311:13:383
891199110,0cyclictest0-21swapper/309:36:313
8910991111,0cyclictest0-21swapper/210:04:392
8910991110,0cyclictest29220-21sshd12:15:482
8910991110,0cyclictest0-21swapper/210:39:022
8910991110,0cyclictest0-21swapper/209:38:172
891099110,0cyclictest29913-21sshd10:42:242
891099110,0cyclictest0-21swapper/208:21:442
8909991111,0cyclictest0-21swapper/111:00:301
8909991111,0cyclictest0-21swapper/109:43:431
8909991111,0cyclictest0-21swapper/107:50:211
8909991110,0cyclictest0-21swapper/108:54:421
890999110,0cyclictest9181-21bash10:03:491
890999110,0cyclictest0-21swapper/108:37:581
890999110,0cyclictest0-21swapper/108:13:071
890999110,0cyclictest0-21swapper/108:04:031
8908991111,0cyclictest0-21swapper/011:20:400
8908991111,0cyclictest0-21swapper/011:13:000
8908991110,0cyclictest5330-21crond10:30:000
8908991110,0cyclictest0-21swapper/009:00:490
890899110,0cyclictest19121-21sshd12:31:400
890899110,0cyclictest0-21swapper/009:13:490
41110,0ktimersoftd/032416-21sshd12:26:160
41110,0ktimersoftd/010613-21bash10:17:120
41110,0ktimersoftd/00-21swapper/007:42:520
271110,0ktimersoftd/222794-21bash10:48:202
1599110,0watchdog/00-21swapper/012:20:150
110050110,0irq/25-eth0660-21sshd10:42:440
110050110,0irq/25-eth020-21ksoftirqd/110:21:041
891199109,0cyclictest0-21swapper/310:23:553
891199109,0cyclictest0-21swapper/308:05:203
891199109,0cyclictest0-21swapper/308:05:203
8911991010,0cyclictest0-21swapper/311:05:583
891099109,0cyclictest14373-21sshd10:27:332
891099109,0cyclictest0-21swapper/208:26:432
8910991010,0cyclictest0-21swapper/211:28:042
8910991010,0cyclictest0-21swapper/209:46:392
8910991010,0cyclictest0-21swapper/207:50:222
891099100,0cyclictest0-21swapper/209:05:452
890999109,0cyclictest482-21diskmemload11:11:331
890999109,0cyclictest0-21swapper/108:31:071
890999109,0cyclictest0-21swapper/108:09:031
890999109,0cyclictest0-21swapper/108:09:031
8909991010,0cyclictest0-21swapper/110:47:011
8909991010,0cyclictest0-21swapper/110:19:091
8909991010,0cyclictest0-21swapper/107:45:281
890999100,0cyclictest25648-21sshd11:21:521
890999100,0cyclictest21410-21sshd11:34:501
890999100,0cyclictest0-21swapper/108:15:171
890899109,0cyclictest26280-21sshd12:15:310
890899109,0cyclictest17018-21sshd10:31:040
890899107,0cyclictest0-21swapper/007:53:200
890899106,0cyclictest0-21swapper/010:05:230
8908991010,0cyclictest482-21diskmemload09:26:150
8908991010,0cyclictest0-21swapper/011:53:270
8908991010,0cyclictest0-21swapper/011:08:420
8908991010,0cyclictest0-21swapper/008:10:030
8908991010,0cyclictest0-21swapper/008:00:590
890899100,0cyclictest0-21swapper/011:15:470
890899100,0cyclictest0-21swapper/010:51:200
890899100,0cyclictest0-21swapper/009:42:580
890899100,0cyclictest0-21swapper/009:37:520
890899100,0cyclictest0-21swapper/008:52:410
890899100,0cyclictest0-21swapper/007:35:180
41100,0ktimersoftd/015866-21id09:31:190
41100,0ktimersoftd/00-21swapper/011:25:150
41100,0ktimersoftd/00-21swapper/010:47:490
41100,0ktimersoftd/00-21swapper/008:40:150
351100,0ktimersoftd/30-21swapper/310:57:303
110050100,0irq/25-eth07054-21sshd12:10:140
110050100,0irq/25-eth036-21ksoftirqd/312:15:043
110050100,0irq/25-eth027936-21sshd10:22:160
110050100,0irq/25-eth012490-21bash10:34:013
110050100,0irq/25-eth00-21swapper/311:22:213
110050100,0irq/25-eth00-21swapper/109:37:061
89119998,0cyclictest19476-21sshd09:58:153
89119990,0cyclictest0-21swapper/312:31:443
89119990,0cyclictest0-21swapper/312:09:013
89109998,0cyclictest0-21swapper/212:28:252
89109998,0cyclictest0-21swapper/211:17:012
89109990,0cyclictest0-21swapper/211:37:482
89109990,0cyclictest0-21swapper/208:56:212
89109990,0cyclictest0-21swapper/208:50:542
89099999,0cyclictest0-21swapper/108:43:541
89099999,0cyclictest0-21swapper/107:40:351
89099999,0cyclictest0-21swapper/107:18:031
89099998,0cyclictest25700-21sshd10:35:181
89099998,0cyclictest21883-21sshd12:18:311
89099998,0cyclictest0-21swapper/107:20:221
89089999,0cyclictest0-21swapper/008:38:030
89089999,0cyclictest0-21swapper/008:31:110
89089999,0cyclictest0-21swapper/008:05:590
89089999,0cyclictest0-21swapper/008:05:590
89089998,0cyclictest0-21swapper/009:57:030
89089993,0cyclictest27204-21needreboot08:55:180
4190,0ktimersoftd/0482-21diskmemload11:49:510
4190,0ktimersoftd/04048-21sshd10:56:210
4190,0ktimersoftd/028943-21sshd11:32:120
4190,0ktimersoftd/022218-21sshd12:05:050
4190,0ktimersoftd/00-21swapper/010:14:440
11005090,0irq/25-eth023936-21sshd11:35:050
11005090,0irq/25-eth021526-21munin-node08:45:120
11005090,0irq/25-eth013814-21bash09:41:033
11005090,0irq/25-eth00-21swapper/312:37:453
11005090,0irq/25-eth00-21swapper/311:40:033
995080,0irq/24-0000:00:28547-21bash11:55:320
89119987,0cyclictest0-21swapper/310:00:273
89109988,0cyclictest0-21swapper/212:05:142
89109988,0cyclictest0-21swapper/211:01:422
89109988,0cyclictest0-21swapper/208:43:202
89109988,0cyclictest0-21swapper/207:32:212
89109980,0cyclictest5117-21sshd11:43:082
89109980,0cyclictest0-21swapper/212:21:592
89109980,0cyclictest0-21swapper/208:15:482
89109980,0cyclictest0-21swapper/208:08:152
89109980,0cyclictest0-21swapper/208:08:152
89109980,0cyclictest0-21swapper/207:28:452
89109980,0cyclictest0-21swapper/207:11:062
89099987,0cyclictest0-21swapper/111:41:291
89099984,0cyclictest27751-21sshd11:48:521
89099980,0cyclictest0-21swapper/107:55:211
89089988,0cyclictest0-21swapper/007:20:060
89089980,0cyclictest0-21swapper/008:15:110
11005080,0irq/25-eth06672-21sshd11:46:353
11005080,0irq/25-eth030146-21sshd12:02:293
11005080,0irq/25-eth022959-21bash10:41:403
11005080,0irq/25-eth02170-21bash12:33:191
11005080,0irq/25-eth017430-21sshd12:24:493
89119977,0cyclictest0-21swapper/308:49:503
89119977,0cyclictest0-21swapper/307:41:173
89119977,0cyclictest0-21swapper/307:20:093
89119977,0cyclictest0-21swapper/307:16:473
89119970,0cyclictest0-21swapper/309:05:163
89119970,0cyclictest0-21swapper/308:03:083
89109977,0cyclictest0-21swapper/208:48:412
89109977,0cyclictest0-21swapper/207:35:572
89109976,0cyclictest10653-21sshd12:30:432
89109972,0cyclictest0-21swapper/208:10:172
89109972,0cyclictest0-21swapper/207:45:172
89109970,0cyclictest0-21swapper/208:00:182
89109970,0cyclictest0-21swapper/207:20:312
89099977,0cyclictest0-21swapper/108:48:531
89099976,0cyclictest0-21swapper/109:01:191
89099973,0cyclictest0-21swapper/112:20:181
89099970,0cyclictest0-21swapper/112:25:201
89089977,0cyclictest0-21swapper/007:56:340
89089970,0cyclictest10345-21switchtime07:10:210
89089970,0cyclictest0-21swapper/008:25:180
159970,0watchdog/00-21swapper/007:45:230
149970,0migration/010594-21munin-node08:20:180
11795070,0irq/26-eth1-rx-19986-21sshd12:35:132
11005070,0irq/25-eth09551-21sshd10:56:552
11005070,0irq/25-eth08355-21sshd11:30:102
11005070,0irq/25-eth04989-21sshd09:30:171
11005070,0irq/25-eth028-21ksoftirqd/210:21:372
11005070,0irq/25-eth028-21ksoftirqd/209:11:012
11005070,0irq/25-eth026724-21sshd11:35:171
11005070,0irq/25-eth023570-21id09:25:302
11005070,0irq/25-eth013926-21sshd12:00:441
11005070,0irq/25-eth010107-21sshd11:50:202
11005070,0irq/25-eth00-21swapper/110:25:141
89119965,0cyclictest8953-21atenall_r7power07:10:113
89119965,0cyclictest28824-21fschecks_time07:50:163
89119965,0cyclictest27250-21nfsd408:55:193
89119964,0cyclictest9613-21munin-run08:20:003
89119962,0cyclictest0-21swapper/309:00:183
89119962,0cyclictest0-21swapper/308:50:173
89119962,0cyclictest0-21swapper/308:40:183
89119962,0cyclictest0-21swapper/308:30:183
89119962,0cyclictest0-21swapper/308:10:173
89119962,0cyclictest0-21swapper/307:55:173
89119962,0cyclictest0-21swapper/307:25:183
89109965,0cyclictest15152-21fschecks_time08:30:162
89109962,0cyclictest0-21swapper/209:00:192
89109962,0cyclictest0-21swapper/208:35:172
89109962,0cyclictest0-21swapper/207:55:172
89109962,0cyclictest0-21swapper/207:40:172
89109962,0cyclictest0-21swapper/207:15:012
89099966,0cyclictest0-21swapper/107:35:421
89099962,0cyclictest0-21swapper/109:05:151
89099962,0cyclictest0-21swapper/108:55:161
89099962,0cyclictest0-21swapper/107:30:201
89099960,0cyclictest0-21swapper/108:25:141
89099960,0cyclictest0-21swapper/107:25:171
89089966,0cyclictest0-21swapper/007:15:060
4160,0ktimersoftd/00-21swapper/007:30:160
89119954,0cyclictest19040-21cut07:30:163
89119950,0cyclictest0-21swapper/308:20:293
89089950,0cyclictest16575-21munin-node07:25:170
11795050,0irq/26-eth1-rx-8458-21kworker/3:208:35:173
11795050,0irq/26-eth1-rx-0-21swapper/108:20:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional