You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-26 - 20:10

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.4.39-rt50+ (Profile)

Latency plot of system in rack #7, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack7slot0.osadl.org (updated Sun Jun 26, 2022 12:45:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
110050680,0irq/25-eth00-21swapper/107:05:251
117950590,0irq/26-eth1-rx-0-21swapper/307:08:413
110050550,0irq/25-eth00-21swapper/207:07:122
117950470,0irq/26-eth1-rx-0-21swapper/007:06:470
26331991717,0cyclictest1529-21sshd11:30:143
26329991716,0cyclictest0-21swapper/110:21:191
26331991615,0cyclictest0-21swapper/311:24:263
26330991614,0cyclictest0-21swapper/209:33:002
26329991514,0cyclictest110050irq/25-eth011:09:451
26331991413,0cyclictest0-21swapper/310:12:463
26331991411,0cyclictest0-21swapper/309:22:223
26329991413,0cyclictest0-21swapper/112:01:271
26329991411,0cyclictest0-21swapper/110:12:221
110050140,0irq/25-eth023833-21sshd10:00:273
26331991312,0cyclictest0-21swapper/312:04:523
26331991312,0cyclictest0-21swapper/310:34:243
26331991311,0cyclictest0-21swapper/312:12:403
26331991311,0cyclictest0-21swapper/310:21:433
2633199130,0cyclictest0-21swapper/309:13:593
26330991312,0cyclictest0-21swapper/210:31:122
26330991312,0cyclictest0-21swapper/210:10:382
26330991311,0cyclictest0-21swapper/209:50:322
26330991311,0cyclictest0-21swapper/207:45:122
2633099130,0cyclictest7514-21sshd09:35:262
2633099130,0cyclictest10453-21sshd11:19:522
2633099130,0cyclictest0-21swapper/210:47:342
2633099130,0cyclictest0-21swapper/210:08:332
26329991312,0cyclictest20-21ksoftirqd/109:36:361
26329991312,0cyclictest1424-21sshd12:35:361
26329991312,0cyclictest0-21swapper/109:19:311
2632999130,0cyclictest0-21swapper/111:43:271
2632999130,0cyclictest0-21swapper/107:20:131
2632999130,0cyclictest0-21swapper/107:20:131
2632899133,0cyclictest0-21swapper/010:20:160
26328991312,0cyclictest0-21swapper/009:35:330
26328991311,0cyclictest1435-21sshd10:40:150
26328991311,0cyclictest0-21swapper/010:59:250
110050130,0irq/25-eth010-21rcuc/009:26:050
110050130,0irq/25-eth00-21swapper/309:33:093
110050130,0irq/25-eth00-21swapper/010:16:250
41120,0ktimersoftd/07414-21sshd11:00:140
41120,0ktimersoftd/017956-21diskmemload11:39:030
26331991212,0cyclictest0-21swapper/311:50:353
26331991212,0cyclictest0-21swapper/307:30:163
26331991211,0cyclictest23343-21bash11:59:533
26331991211,0cyclictest16994-21sshd10:45:533
26331991211,0cyclictest0-21swapper/312:21:353
26331991211,0cyclictest0-21swapper/311:00:243
26331991211,0cyclictest0-21swapper/310:52:103
26331991211,0cyclictest0-21swapper/310:52:093
26331991210,0cyclictest17956-21diskmemload09:50:353
26331991210,0cyclictest0-21swapper/309:59:193
2633199120,0cyclictest0-21swapper/311:06:143
2633199120,0cyclictest0-21swapper/310:16:573
2633199120,0cyclictest0-21swapper/309:36:253
26330991211,0cyclictest0-21swapper/212:00:252
26330991211,0cyclictest0-21swapper/210:16:542
26330991211,0cyclictest0-21swapper/210:04:582
26330991211,0cyclictest0-21swapper/209:10:212
26330991211,0cyclictest0-21swapper/207:35:202
26330991210,0cyclictest0-21swapper/210:23:462
26330991210,0cyclictest0-21swapper/209:59:152
2633099120,0cyclictest0-21swapper/212:33:592
2633099120,0cyclictest0-21swapper/212:26:412
2633099120,0cyclictest0-21swapper/212:21:192
2633099120,0cyclictest0-21swapper/209:40:542
26329991211,0cyclictest22767-21sshd11:32:451
26329991211,0cyclictest17956-21diskmemload09:52:161
26329991211,0cyclictest16701-21awk07:55:181
26329991211,0cyclictest12564-21sshd10:26:051
26329991211,0cyclictest0-21swapper/111:51:201
26329991211,0cyclictest0-21swapper/110:06:411
26329991210,0cyclictest0-21swapper/110:47:131
26329991210,0cyclictest0-21swapper/110:00:591
26329991210,0cyclictest0-21swapper/109:57:231
2632999120,0cyclictest0-21swapper/110:40:371
2632999120,0cyclictest0-21swapper/110:35:431
26328991212,0cyclictest14218-21ls07:50:180
26328991212,0cyclictest0-21swapper/011:26:010
26328991211,0cyclictest5181-21open_files07:30:200
26328991211,0cyclictest1651-21sshd11:34:100
26328991210,0cyclictest0-21swapper/009:33:070
26328991210,0cyclictest0-21swapper/009:11:020
2632899120,0cyclictest25885-21bash11:17:460
2632899120,0cyclictest19181-21bash10:26:540
2632899120,0cyclictest0-21swapper/012:00:380
110050120,0irq/25-eth00-21swapper/212:37:002
9950110,0irq/24-0000:00:0-21swapper/012:33:450
41110,0ktimersoftd/01502-21bash12:24:120
271110,0ktimersoftd/20-21swapper/211:51:362
26331991111,0cyclictest0-21swapper/310:39:153
26331991111,0cyclictest0-21swapper/309:25:433
26331991111,0cyclictest0-21swapper/308:22:253
26331991110,0cyclictest0-21swapper/309:42:273
2633199110,0cyclictest0-21swapper/311:46:393
2633199110,0cyclictest0-21swapper/308:05:333
26330991111,0cyclictest0-21swapper/212:05:242
26330991111,0cyclictest0-21swapper/210:50:082
26330991111,0cyclictest0-21swapper/210:50:082
26330991110,0cyclictest4518-21sshd11:34:302
26330991110,0cyclictest29536-21sshd11:45:112
26330991110,0cyclictest17956-21diskmemload12:15:582
26330991110,0cyclictest0-21swapper/210:35:312
2633099110,0cyclictest0-21swapper/211:12:512
26329991111,0cyclictest0-21swapper/112:22:561
26329991111,0cyclictest0-21swapper/111:26:361
26329991111,0cyclictest0-21swapper/111:01:451
26329991110,0cyclictest8512-21sshd09:47:101
26329991110,0cyclictest20-21ksoftirqd/111:14:381
26329991110,0cyclictest0-21swapper/112:26:181
26329991110,0cyclictest0-21swapper/111:49:221
26329991110,0cyclictest0-21swapper/110:30:501
26329991110,0cyclictest0-21swapper/110:19:131
26329991110,0cyclictest0-21swapper/109:31:431
2632999110,0cyclictest25922-21sshd12:15:261
26328991111,0cyclictest0-21swapper/010:47:280
26328991111,0cyclictest0-21swapper/008:30:230
26328991110,0cyclictest31410-21rm11:06:520
26328991110,0cyclictest0-21swapper/012:25:300
26328991110,0cyclictest0-21swapper/010:13:460
2632899110,0cyclictest7565-21sshd09:47:040
2632899110,0cyclictest17956-21diskmemload11:24:390
2632899110,0cyclictest17956-21diskmemload10:02:230
2632899110,0cyclictest0-21swapper/010:05:590
2632899110,0cyclictest0-21swapper/009:57:440
2632899110,0cyclictest0-21swapper/008:45:120
110050110,0irq/25-eth00-21swapper/309:47:563
110050110,0irq/25-eth00-21swapper/111:59:001
110050110,0irq/25-eth00-21swapper/009:53:400
110050110,0irq/25-eth00-21swapper/009:19:330
41100,0ktimersoftd/00-21swapper/008:53:090
271100,0ktimersoftd/20-21swapper/208:53:092
2633199109,0cyclictest13093-21sshd11:35:223
2633199109,0cyclictest0-21swapper/310:57:163
2633199109,0cyclictest0-21swapper/307:55:563
2633199109,0cyclictest0-21swapper/307:40:153
26331991010,0cyclictest14293-21sshd12:25:333
26331991010,0cyclictest0-21swapper/311:25:503
26331991010,0cyclictest0-21swapper/311:17:353
26331991010,0cyclictest0-21swapper/310:26:293
26331991010,0cyclictest0-21swapper/309:16:403
2633199100,0cyclictest0-21swapper/312:30:483
2633199100,0cyclictest0-21swapper/309:04:073
2633099109,0cyclictest21707-21sshd10:27:132
2633099109,0cyclictest0-21swapper/212:13:112
2633099109,0cyclictest0-21swapper/211:37:532
26330991010,0cyclictest0-21swapper/210:40:572
2632999109,0cyclictest12518-21sshd11:20:061
2632999109,0cyclictest0-21swapper/112:31:401
2632999109,0cyclictest0-21swapper/109:22:321
2632999109,0cyclictest0-21swapper/108:59:111
26329991010,0cyclictest17956-21diskmemload12:06:271
26329991010,0cyclictest0-21swapper/111:36:071
26329991010,0cyclictest0-21swapper/108:48:371
26329991010,0cyclictest0-21swapper/108:27:011
26329991010,0cyclictest0-21swapper/108:14:071
26329991010,0cyclictest0-21swapper/108:06:551
26329991010,0cyclictest0-21swapper/107:47:031
26329991010,0cyclictest0-21swapper/107:43:551
2632999100,0cyclictest0-21swapper/110:58:361
2632999100,0cyclictest0-21swapper/108:19:071
2632899109,0cyclictest0-21swapper/012:38:450
2632899109,0cyclictest0-21swapper/010:53:090
2632899109,0cyclictest0-21swapper/010:53:090
2632899109,0cyclictest0-21swapper/010:39:400
26328991010,0cyclictest0-21swapper/009:20:340
2632899100,0cyclictest0-21swapper/008:09:340
4190,0ktimersoftd/017956-21diskmemload12:19:450
4190,0ktimersoftd/017956-21diskmemload11:10:440
4190,0ktimersoftd/01620-21runrttasks08:56:170
4190,0ktimersoftd/010060-21ls11:50:240
27190,0ktimersoftd/20-21swapper/208:07:052
263319999,0cyclictest0-21swapper/311:40:423
263319999,0cyclictest0-21swapper/308:31:293
263319999,0cyclictest0-21swapper/307:36:323
263319999,0cyclictest0-21swapper/307:26:333
263319998,0cyclictest5258-21sshd12:16:503
263319998,0cyclictest0-21swapper/310:43:143
263319990,0cyclictest0-21swapper/307:10:213
263309999,0cyclictest10457-21sshd07:42:182
263309999,0cyclictest0-21swapper/210:55:152
263309998,0cyclictest21811-21sshd11:05:402
263309998,0cyclictest0-21swapper/211:26:222
263309998,0cyclictest0-21swapper/211:20:432
263309990,0cyclictest17462-21sshd09:25:142
263309990,0cyclictest15074-21sshd11:01:022
263309990,0cyclictest0-21swapper/209:19:592
263299999,0cyclictest17956-21diskmemload09:14:451
263299999,0cyclictest0-21swapper/109:25:541
263299999,0cyclictest0-21swapper/107:52:451
263299997,0cyclictest20-21ksoftirqd/109:42:001
263299990,0cyclictest14713-21sshd12:10:171
263289999,0cyclictest0-21swapper/009:41:010
263289998,0cyclictest17956-21diskmemload11:55:520
263289998,0cyclictest0-21swapper/010:34:140
263289992,0cyclictest0-21swapper/011:45:170
263289990,0cyclictest31105-21sshd12:12:150
159990,0watchdog/00-21swapper/012:05:310
263319988,0cyclictest0-21swapper/312:09:523
263319988,0cyclictest0-21swapper/311:12:083
263319988,0cyclictest0-21swapper/309:09:493
263319988,0cyclictest0-21swapper/308:47:303
263319988,0cyclictest0-21swapper/308:16:503
263319988,0cyclictest0-21swapper/307:15:443
263309988,0cyclictest0-21swapper/208:35:162
263309987,0cyclictest0-21swapper/211:55:392
263309984,0cyclictest8380-21if_eth109:20:162
263309980,0cyclictest0-21swapper/209:47:572
263309980,0cyclictest0-21swapper/208:42:212
263299988,0cyclictest20-21ksoftirqd/107:36:281
263299988,0cyclictest0-21swapper/109:06:231
263299988,0cyclictest0-21swapper/108:02:231
263299988,0cyclictest0-21swapper/107:16:161
263299987,0cyclictest6044-21sshd10:52:201
263299987,0cyclictest6044-21sshd10:52:201
263299987,0cyclictest29355-21perf08:25:001
263299983,0cyclictest0-21swapper/107:29:091
263299980,0cyclictest0-21swapper/111:15:261
263289985,0cyclictest0-21swapper/008:35:140
263289985,0cyclictest0-21swapper/007:45:120
263289980,0cyclictest0-21swapper/008:40:120
263289980,0cyclictest0-21swapper/008:15:210
11005080,0irq/25-eth032101-21sshd10:05:193
11005080,0irq/25-eth00-21swapper/312:37:443
11005080,0irq/25-eth00-21swapper/011:40:100
263319977,0cyclictest0-21swapper/308:12:263
263319977,0cyclictest0-21swapper/307:50:143
263309973,0cyclictest0-21swapper/207:25:162
263309973,0cyclictest0-21swapper/207:15:172
263309970,0cyclictest0-21swapper/209:05:172
263299977,0cyclictest0-21swapper/108:50:081
263299977,0cyclictest0-21swapper/107:12:401
263299976,0cyclictest20-21ksoftirqd/108:40:181
263299974,0cyclictest0-21swapper/108:37:171
263299973,0cyclictest0-21swapper/109:00:151
263289970,0cyclictest0-21swapper/008:10:160
263289970,0cyclictest0-21swapper/007:35:160
263289970,0cyclictest0-21swapper/007:20:120
263289970,0cyclictest0-21swapper/007:20:120
263289970,0cyclictest0-21swapper/007:10:150
259970,0migration/225342-21sshd11:40:412
11005070,0irq/25-eth00-21swapper/009:09:420
11005070,0irq/25-eth00-21swapper/009:04:430
339960,0migration/34381-21cpuspeed_turbos08:40:123
263319966,0cyclictest0-21swapper/307:22:153
263319966,0cyclictest0-21swapper/307:22:153
263319962,0cyclictest0-21swapper/308:55:163
263319962,0cyclictest0-21swapper/308:50:163
263319962,0cyclictest0-21swapper/308:35:163
263319962,0cyclictest0-21swapper/308:00:163
263309966,0cyclictest0-21swapper/209:03:572
263309962,0cyclictest0-21swapper/208:55:162
263309962,0cyclictest0-21swapper/208:45:162
263309962,0cyclictest0-21swapper/208:25:162
263309962,0cyclictest0-21swapper/208:15:192
263309962,0cyclictest0-21swapper/207:55:162
263309962,0cyclictest0-21swapper/207:50:182
263309962,0cyclictest0-21swapper/207:20:162
263309962,0cyclictest0-21swapper/207:20:162
263309962,0cyclictest0-21swapper/207:10:152
263309960,0cyclictest0-21swapper/208:04:152
263299965,0cyclictest4154-21cpuspeed_turbos07:30:131
263299965,0cyclictest20-21ksoftirqd/108:30:141
263289965,0cyclictest1620-21runrttasks07:40:000
263289962,0cyclictest0-21swapper/008:25:160
263289962,0cyclictest0-21swapper/008:20:170
263289962,0cyclictest0-21swapper/007:25:160
263289962,0cyclictest0-21swapper/007:15:020
259960,0migration/228673-21switchtime08:20:222
149960,0migration/015909-21cstates07:55:120
11005060,0irq/25-eth00-21swapper/008:00:130
263319955,0cyclictest0-21swapper/307:47:063
263319950,0cyclictest0-21swapper/308:26:333
263309954,0cyclictest23017-21diskstats08:10:132
263309950,0cyclictest0-21swapper/208:30:052
263309950,0cyclictest0-21swapper/207:30:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional