You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-07-29 - 16:49

Intel(R) Xeon(R) CPU E3-1220L V2 @ 2.30GHz, Linux 4.4.39-rt50+ (Profile)

Latency plot of system in rack #7, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack7slot0.osadl.org (updated Thu Jul 29, 2021 12:45:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117950650,0irq/26-eth1-rx-0-21swapper/007:05:190
110050610,0irq/25-eth00-21swapper/107:05:261
110050590,0irq/25-eth00-21swapper/307:08:223
1438524223,0sleep20-21swapper/207:05:532
117950270,0irq/26-eth1-rx-0-21swapper/107:10:011
1497999160,0cyclictest0-21swapper/111:45:581
1498199151,0cyclictest0-21swapper/311:29:193
14980991513,0cyclictest0-21swapper/209:15:142
14979991514,0cyclictest18090-21sshd12:22:121
14979991511,0cyclictest28446-21bash10:01:321
14979991511,0cyclictest28446-21bash10:01:321
14978991510,0cyclictest0-21swapper/009:57:140
14978991510,0cyclictest0-21swapper/009:57:130
351140,0ktimersoftd/30-21swapper/311:06:193
14981991413,0cyclictest0-21swapper/310:00:153
14981991413,0cyclictest0-21swapper/310:00:143
14981991413,0cyclictest0-21swapper/308:05:403
14980991413,0cyclictest0-21swapper/211:28:152
14980991413,0cyclictest0-21swapper/209:13:302
14980991411,0cyclictest0-21swapper/211:41:502
1498099140,0cyclictest0-21swapper/211:15:222
14979991413,0cyclictest0-21swapper/109:35:031
14979991413,0cyclictest0-21swapper/108:00:161
351130,0ktimersoftd/30-21swapper/310:31:083
14981991313,0cyclictest0-21swapper/311:00:453
14981991312,0cyclictest110050irq/25-eth011:55:493
14981991312,0cyclictest0-21swapper/312:30:113
14981991312,0cyclictest0-21swapper/310:21:013
14981991312,0cyclictest0-21swapper/309:32:003
1498199130,0cyclictest16317-21sshd09:29:073
1498199130,0cyclictest0-21swapper/311:39:473
14980991312,0cyclictest480-21sshd12:37:362
14980991312,0cyclictest0-21swapper/211:49:452
14980991311,0cyclictest0-21swapper/211:51:572
1498099130,0cyclictest0-21swapper/209:41:452
14979991312,0cyclictest0-21swapper/112:15:361
14979991312,0cyclictest0-21swapper/112:05:501
14979991312,0cyclictest0-21swapper/110:54:231
14979991311,0cyclictest27356-21sshd11:07:591
14979991311,0cyclictest0-21swapper/111:30:241
1497999130,0cyclictest12604-21fschecks_time11:50:231
1497999130,0cyclictest0-21swapper/112:10:071
1497999130,0cyclictest0-21swapper/109:33:531
14978991312,0cyclictest0-21swapper/012:10:550
14978991312,0cyclictest0-21swapper/010:23:010
14978991311,0cyclictest10029-21sshd11:36:390
110050130,0irq/25-eth06589-21diskmemload12:17:132
351120,0ktimersoftd/313886-21bash12:35:053
14981991212,0cyclictest0-21swapper/312:00:273
14981991211,0cyclictest14054-21munin-node10:35:163
14981991211,0cyclictest12666-21sshd12:17:003
14981991211,0cyclictest0-21swapper/311:54:183
14981991211,0cyclictest0-21swapper/311:34:133
14981991211,0cyclictest0-21swapper/311:11:123
14981991211,0cyclictest0-21swapper/309:15:153
14981991210,0cyclictest5220-21sshd10:51:353
14981991210,0cyclictest0-21swapper/311:17:223
14981991210,0cyclictest0-21swapper/307:40:293
1498199120,0cyclictest0-21swapper/312:09:493
1498199120,0cyclictest0-21swapper/310:57:303
1498199120,0cyclictest0-21swapper/309:58:293
1498199120,0cyclictest0-21swapper/309:58:293
14980991211,0cyclictest16106-21sshd12:21:552
14980991211,0cyclictest0-21swapper/212:11:212
14980991211,0cyclictest0-21swapper/211:24:542
14980991211,0cyclictest0-21swapper/210:08:482
1498099120,0cyclictest15913-21sshd10:22:022
14979991212,0cyclictest0-21swapper/111:20:171
14979991211,0cyclictest16336-21sshd10:30:551
14979991210,0cyclictest6589-21diskmemload10:11:451
14979991210,0cyclictest0-21swapper/111:15:041
1497999120,0cyclictest0-21swapper/110:40:271
1497999120,0cyclictest0-21swapper/110:21:101
1497999120,0cyclictest0-21swapper/109:15:211
14978991212,0cyclictest0-21swapper/010:45:540
14978991211,0cyclictest1453-21nfsd10:33:420
14978991211,0cyclictest0-21swapper/010:18:360
14978991211,0cyclictest0-21swapper/009:40:020
1497899120,0cyclictest0-21swapper/011:46:460
1497899120,0cyclictest0-21swapper/009:33:170
117950120,0irq/26-eth1-rx-17876-21ls11:55:252
351110,0ktimersoftd/30-21swapper/307:10:173
271110,0ktimersoftd/20-21swapper/211:14:112
191110,0ktimersoftd/10-21swapper/112:35:041
191110,0ktimersoftd/10-21swapper/107:57:001
1498199112,0cyclictest0-21swapper/312:20:203
14981991111,0cyclictest0-21swapper/311:48:483
14981991111,0cyclictest0-21swapper/310:26:023
14981991111,0cyclictest0-21swapper/310:11:373
14981991110,0cyclictest30677-21sshd09:48:423
14981991110,0cyclictest30649-21sshd11:21:393
14981991110,0cyclictest0-21swapper/312:28:413
14981991110,0cyclictest0-21swapper/312:11:293
14981991110,0cyclictest0-21swapper/310:46:143
1498199110,0cyclictest6632-21bash10:42:583
1498199110,0cyclictest0-21swapper/308:51:483
1498199110,0cyclictest0-21swapper/308:03:363
14980991111,0cyclictest0-21swapper/210:26:272
14980991110,0cyclictest0-21swapper/212:03:412
14980991110,0cyclictest0-21swapper/211:36:312
14980991110,0cyclictest0-21swapper/210:57:562
14980991110,0cyclictest0-21swapper/210:52:002
14980991110,0cyclictest0-21swapper/207:51:572
1498099110,0cyclictest0-21swapper/210:12:372
1498099110,0cyclictest0-21swapper/209:09:272
1498099110,0cyclictest0-21swapper/208:27:092
1498099110,0cyclictest0-21swapper/208:15:112
1498099110,0cyclictest0-21swapper/208:05:202
1497999119,0cyclictest0-21swapper/107:16:421
14979991110,0cyclictest0-21swapper/110:35:421
1497999110,0cyclictest0-21swapper/108:08:511
14978991111,0cyclictest0-21swapper/012:17:540
14978991111,0cyclictest0-21swapper/011:43:170
14978991111,0cyclictest0-21swapper/010:14:110
14978991110,0cyclictest0-21swapper/011:27:290
14978991110,0cyclictest0-21swapper/011:24:070
14978991110,0cyclictest0-21swapper/010:53:550
1497899110,0cyclictest0-21swapper/011:58:590
1497899110,0cyclictest0-21swapper/009:39:270
110050110,0irq/25-eth06589-21diskmemload11:32:332
110050110,0irq/25-eth06589-21diskmemload11:10:260
110050110,0irq/25-eth028299-21bash09:35:083
41100,0ktimersoftd/030486-21sshd10:28:340
41100,0ktimersoftd/02139-21sshd11:04:360
41100,0ktimersoftd/016676-21munin-node10:35:240
41100,0ktimersoftd/014094-21bash12:21:380
41100,0ktimersoftd/00-21swapper/009:17:510
271100,0ktimersoftd/20-21swapper/208:56:042
1498199109,0cyclictest0-21swapper/309:51:223
1498199109,0cyclictest0-21swapper/307:30:233
1498199108,0cyclictest0-21swapper/308:21:083
14981991010,0cyclictest0-21swapper/309:06:063
14981991010,0cyclictest0-21swapper/307:57:413
14981991010,0cyclictest0-21swapper/307:15:373
1498199100,0cyclictest0-21swapper/311:41:243
1498199100,0cyclictest0-21swapper/309:40:253
1498199100,0cyclictest0-21swapper/309:10:173
1498199100,0cyclictest0-21swapper/308:38:063
1498099109,0cyclictest30251-21bash12:32:482
1498099109,0cyclictest21407-21sshd09:47:222
1498099109,0cyclictest15869-21sshd10:17:372
1498099109,0cyclictest0-21swapper/207:19:122
14980991010,0cyclictest0-21swapper/210:35:582
14980991010,0cyclictest0-21swapper/210:31:142
14980991010,0cyclictest0-21swapper/208:04:582
14980991010,0cyclictest0-21swapper/207:40:062
1498099100,0cyclictest0-21swapper/212:07:582
1497999109,0cyclictest26368-21bash11:38:591
1497999109,0cyclictest21695-21bash12:00:241
1497999109,0cyclictest0-21swapper/111:58:091
1497999109,0cyclictest0-21swapper/109:56:141
1497999109,0cyclictest0-21swapper/109:56:131
14979991010,0cyclictest0-21swapper/110:16:451
14979991010,0cyclictest0-21swapper/107:41:261
1497999100,0cyclictest0-21swapper/110:25:411
1497999100,0cyclictest0-21swapper/109:28:211
1497899109,0cyclictest0-21swapper/012:06:380
1497899109,0cyclictest0-21swapper/011:30:520
1497899109,0cyclictest0-21swapper/010:59:500
14978991010,0cyclictest1453-21nfsd09:23:250
14978991010,0cyclictest0-21swapper/011:51:110
14978991010,0cyclictest0-21swapper/008:46:500
1497899100,0cyclictest0-21swapper/008:31:160
110050100,0irq/25-eth026-21rcuc/212:27:592
110050100,0irq/25-eth00-21swapper/109:50:301
110050100,0irq/25-eth00-21swapper/010:00:340
110050100,0irq/25-eth00-21swapper/010:00:330
4190,0ktimersoftd/032262-21sshd09:53:200
4190,0ktimersoftd/027152-21bash09:26:030
4190,0ktimersoftd/00-21swapper/011:15:370
4190,0ktimersoftd/00-21swapper/011:07:350
149819999,0cyclictest0-21swapper/308:29:373
149819999,0cyclictest0-21swapper/308:11:303
149819998,0cyclictest0-21swapper/310:16:363
149809999,0cyclictest0-21swapper/208:54:342
149809999,0cyclictest0-21swapper/207:46:022
149809999,0cyclictest0-21swapper/207:37:262
149809999,0cyclictest0-21swapper/207:32:052
149809998,0cyclictest0-21swapper/207:10:292
149809990,0cyclictest0-21swapper/211:08:142
149809990,0cyclictest0-21swapper/210:40:082
149809990,0cyclictest0-21swapper/209:37:522
149809990,0cyclictest0-21swapper/209:31:452
149809990,0cyclictest0-21swapper/209:21:402
149809990,0cyclictest0-21swapper/208:37:572
149799999,0cyclictest0-21swapper/111:42:301
149799999,0cyclictest0-21swapper/110:59:271
149799999,0cyclictest0-21swapper/108:38:011
149799999,0cyclictest0-21swapper/108:17:061
149799998,0cyclictest6589-21diskmemload10:06:111
149799998,0cyclictest0-21swapper/112:34:531
149799998,0cyclictest0-21swapper/111:04:161
149799990,0cyclictest0-21swapper/109:21:401
149799990,0cyclictest0-21swapper/107:30:031
149789999,0cyclictest0-21swapper/012:27:320
149789998,0cyclictest0-21swapper/012:30:330
149789998,0cyclictest0-21swapper/010:41:080
149789998,0cyclictest0-21swapper/008:40:400
149789998,0cyclictest0-21swapper/007:42:420
149789998,0cyclictest0-21swapper/007:27:430
149789990,0cyclictest0-21swapper/008:35:410
11005090,0irq/25-eth00-21swapper/112:27:011
11005090,0irq/25-eth00-21swapper/111:26:441
4180,0ktimersoftd/08414-21bash12:38:450
4180,0ktimersoftd/07594-21sshd09:10:070
4180,0ktimersoftd/00-21swapper/012:00:450
4180,0ktimersoftd/00-21swapper/009:47:270
4180,0ktimersoftd/00-21swapper/008:52:480
159980,0watchdog/010406-21sshd10:08:030
149819988,0cyclictest0-21swapper/307:26:473
149819987,0cyclictest0-21swapper/310:05:153
149809988,0cyclictest0-21swapper/209:52:242
149809988,0cyclictest0-21swapper/207:24:172
149809987,0cyclictest22442-21sshd11:02:512
149809987,0cyclictest0-21swapper/210:48:482
149809987,0cyclictest0-21swapper/209:30:002
149799988,0cyclictest26971-21sshd10:45:391
149799988,0cyclictest0-21swapper/109:41:211
149799988,0cyclictest0-21swapper/108:21:311
149799987,0cyclictest0-21swapper/111:13:261
149789988,0cyclictest0-21swapper/009:08:330
149789988,0cyclictest0-21swapper/008:26:520
149789988,0cyclictest0-21swapper/008:13:360
149789988,0cyclictest0-21swapper/008:00:010
149789988,0cyclictest0-21swapper/007:32:500
149789980,0cyclictest0-21swapper/008:08:370
149789980,0cyclictest0-21swapper/007:20:220
11005080,0irq/25-eth026439-21sshd09:48:061
4170,0ktimersoftd/02340-21forks07:50:140
19170,0ktimersoftd/10-21swapper/107:29:291
149819977,0cyclictest0-21swapper/308:30:123
149819977,0cyclictest0-21swapper/307:49:053
149819973,0cyclictest0-21swapper/308:40:243
149809977,0cyclictest0-21swapper/207:55:122
149809977,0cyclictest0-21swapper/207:27:542
149809976,0cyclictest12449-21sshd09:59:302
149809976,0cyclictest12449-21sshd09:59:302
149809973,0cyclictest0-21swapper/208:45:172
149799970,0cyclictest0-21swapper/109:10:211
149789977,0cyclictest0-21swapper/007:38:310
149789970,0cyclictest32345-21df07:45:150
149789970,0cyclictest0-21swapper/009:02:580
149789970,0cyclictest0-21swapper/008:20:190
149789970,0cyclictest0-21swapper/007:55:230
149789970,0cyclictest0-21swapper/007:15:210
11795070,0irq/26-eth1-rx-0-21swapper/008:15:270
11005070,0irq/25-eth020878-21bash09:20:413
11005070,0irq/25-eth016296-21head07:10:250
11005070,0irq/25-eth012896-21sshd10:03:572
11005070,0irq/25-eth012896-21sshd10:03:572
149819962,0cyclictest0-21swapper/309:00:153
149819962,0cyclictest0-21swapper/308:55:423
149819962,0cyclictest0-21swapper/308:15:173
149819962,0cyclictest0-21swapper/307:50:173
149819962,0cyclictest0-21swapper/307:20:193
149819961,0cyclictest0-21swapper/308:45:173
149809965,0cyclictest2967-21if_eth009:00:142
149809962,0cyclictest0-21swapper/208:30:192
149809962,0cyclictest0-21swapper/208:20:172
149809962,0cyclictest0-21swapper/208:10:232
149799966,0cyclictest0-21swapper/108:12:411
149799966,0cyclictest0-21swapper/107:35:451
149799965,0cyclictest29880-21munin-node08:50:261
149799962,0cyclictest0-21swapper/109:05:231
149799962,0cyclictest0-21swapper/109:00:151
149799962,0cyclictest0-21swapper/108:55:421
149799962,0cyclictest0-21swapper/108:40:241
149799962,0cyclictest0-21swapper/107:50:161
149799962,0cyclictest0-21swapper/107:45:201
149799962,0cyclictest0-21swapper/107:20:191
149789964,0cyclictest32226-21munin-node08:55:410
149819950,0cyclictest0-21swapper/307:35:073
149809950,0cyclictest0-21swapper/208:40:252
149799953,0cyclictest0-21swapper/108:30:191
149799950,0cyclictest0-21swapper/108:45:161
149799950,0cyclictest0-21swapper/108:25:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional