You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-03 - 19:24

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.4.39-rt50+ (Profile)

Latency plot of system in rack #7, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack7slot0.osadl.org (updated Sat Jun 03, 2023 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117950620,0irq/26-eth1-rx-191ktimersoftd/107:06:011
117950620,0irq/26-eth1-rx-191ktimersoftd/107:06:011
110050480,0irq/25-eth00-21swapper/307:06:203
110050480,0irq/25-eth00-21swapper/307:06:193
756124522,0sleep00-21swapper/007:08:300
756124522,0sleep00-21swapper/007:08:290
117950430,0irq/26-eth1-rx-0-21swapper/207:07:052
117950430,0irq/26-eth1-rx-0-21swapper/207:07:042
7950992423,0cyclictest0-21swapper/110:30:371
795299202,0cyclictest21053-21sshd11:35:253
794999201,0cyclictest5392-21sshd10:13:220
271180,0ktimersoftd/26945-21id11:40:512
7951991615,0cyclictest23505-21sshd10:08:212
7951991615,0cyclictest23505-21sshd10:08:212
110050160,0irq/25-eth00-21swapper/311:54:143
7952991512,0cyclictest0-21swapper/308:30:213
7951991511,0cyclictest0-21swapper/212:19:572
794999150,0cyclictest0-21swapper/012:26:470
7952991413,0cyclictest24893-21sshd10:22:283
7952991413,0cyclictest24893-21sshd10:22:273
7952991412,0cyclictest0-21swapper/312:26:113
795199140,0cyclictest0-21swapper/207:15:022
7950991413,0cyclictest0-21swapper/109:50:331
7952991313,0cyclictest0-21swapper/310:13:313
7952991312,0cyclictest0-21swapper/311:02:463
7952991311,0cyclictest31984-21diskmemload12:08:593
7952991311,0cyclictest0-21swapper/311:23:413
795299130,0cyclictest0-21swapper/310:17:423
7951991312,0cyclictest0-21swapper/212:33:542
7951991312,0cyclictest0-21swapper/211:55:202
7951991312,0cyclictest0-21swapper/211:02:082
7951991312,0cyclictest0-21swapper/209:49:452
795199130,0cyclictest0-21swapper/209:28:092
7950991312,0cyclictest0-21swapper/111:57:171
7950991312,0cyclictest0-21swapper/111:01:241
7950991311,0cyclictest31984-21diskmemload10:57:141
7950991311,0cyclictest0-21swapper/112:05:181
7950991311,0cyclictest0-21swapper/110:22:161
7950991311,0cyclictest0-21swapper/110:22:161
795099130,0cyclictest0-21swapper/112:33:111
7949991312,0cyclictest0-21swapper/010:33:040
794999130,0cyclictest8020-21sshd10:59:050
794999130,0cyclictest0-21swapper/011:49:230
110050130,0irq/25-eth014209-21sshd10:14:221
110050130,0irq/25-eth012319-21sshd10:17:371
110050130,0irq/25-eth00-21swapper/111:09:041
7952991211,0cyclictest31984-21diskmemload11:49:073
7952991211,0cyclictest25244-21sshd12:14:203
7952991211,0cyclictest0-21swapper/310:50:133
7952991211,0cyclictest0-21swapper/310:09:203
7952991211,0cyclictest0-21swapper/310:09:193
7952991211,0cyclictest0-21swapper/309:52:153
795299120,0cyclictest0-21swapper/312:20:153
795299120,0cyclictest0-21swapper/309:57:573
7951991211,0cyclictest0-21swapper/210:29:152
7951991211,0cyclictest0-21swapper/210:14:372
7951991210,0cyclictest0-21swapper/212:14:022
795199120,0cyclictest0-21swapper/211:39:512
795199120,0cyclictest0-21swapper/211:19:472
795199120,0cyclictest0-21swapper/211:12:002
795199120,0cyclictest0-21swapper/207:25:222
7950991211,0cyclictest31984-21diskmemload11:13:221
7950991211,0cyclictest31984-21diskmemload10:36:541
7950991211,0cyclictest0-21swapper/112:13:191
7950991211,0cyclictest0-21swapper/109:38:351
7950991210,0cyclictest0-21swapper/112:21:541
7950991210,0cyclictest0-21swapper/110:28:321
795099120,0cyclictest25858-21sshd11:39:311
795099120,0cyclictest0-21swapper/111:42:461
795099120,0cyclictest0-21swapper/111:33:351
795099120,0cyclictest0-21swapper/109:48:271
7949991211,0cyclictest7318-21sshd09:10:490
7949991211,0cyclictest0-21swapper/012:10:460
7949991211,0cyclictest0-21swapper/009:36:300
7949991211,0cyclictest0-21swapper/008:30:230
7949991210,0cyclictest19298-21bash10:28:530
7949991210,0cyclictest0-21swapper/011:29:300
7949991210,0cyclictest0-21swapper/009:49:570
794999120,0cyclictest8614-21sshd12:05:260
271120,0ktimersoftd/221204-21sshd12:24:222
110050120,0irq/25-eth00-21swapper/311:40:523
7952991111,0cyclictest0-21swapper/312:00:583
7952991111,0cyclictest0-21swapper/311:16:503
7952991110,0cyclictest17672-21sshd10:46:033
7952991110,0cyclictest0-21swapper/310:56:303
795299110,0cyclictest12148-21bash10:03:393
795299110,0cyclictest0-21swapper/308:24:343
795299110,0cyclictest0-21swapper/307:14:103
795299110,0cyclictest0-21swapper/307:14:103
7951991111,0cyclictest28603-21sshd11:46:442
7951991111,0cyclictest0-21swapper/212:39:142
7951991111,0cyclictest0-21swapper/212:28:332
7951991111,0cyclictest0-21swapper/211:34:532
7951991111,0cyclictest0-21swapper/210:31:212
7951991110,0cyclictest0-21swapper/210:37:372
7951991110,0cyclictest0-21swapper/209:55:262
795199110,0cyclictest31984-21diskmemload09:34:112
795199110,0cyclictest0-21swapper/211:28:232
795199110,0cyclictest0-21swapper/210:51:402
7950991111,0cyclictest0-21swapper/111:27:401
7950991111,0cyclictest0-21swapper/107:30:261
7950991110,0cyclictest29010-21sshd10:01:551
7950991110,0cyclictest21418-21sshd12:27:501
7950991110,0cyclictest0-21swapper/111:48:411
7950991110,0cyclictest0-21swapper/110:07:371
7950991110,0cyclictest0-21swapper/110:07:371
7950991110,0cyclictest0-21swapper/108:25:231
795099110,0cyclictest6758-21id11:51:211
795099110,0cyclictest31768-21sshd12:35:511
795099110,0cyclictest0-21swapper/107:50:531
7949991110,0cyclictest31984-21diskmemload09:16:520
7949991110,0cyclictest23928-21sshd10:01:210
7949991110,0cyclictest0-21swapper/010:51:180
794999110,0cyclictest0-21swapper/012:21:270
794999110,0cyclictest0-21swapper/011:54:420
794999110,0cyclictest0-21swapper/009:42:110
41110,0ktimersoftd/08159-21sshd11:13:010
41110,0ktimersoftd/020573-21cp11:38:550
41110,0ktimersoftd/00-21swapper/010:22:370
41110,0ktimersoftd/00-21swapper/010:22:360
110050110,0irq/25-eth031479-21sshd11:05:063
795299109,0cyclictest23454-21sshd12:17:353
795299109,0cyclictest2299-21bash09:10:193
795299109,0cyclictest0-21swapper/310:41:523
795299109,0cyclictest0-21swapper/307:51:413
7952991010,0cyclictest0-21swapper/312:32:063
7952991010,0cyclictest0-21swapper/309:40:183
7952991010,0cyclictest0-21swapper/308:41:033
7952991010,0cyclictest0-21swapper/308:11:043
7952991010,0cyclictest0-21swapper/307:44:363
795299100,0cyclictest0-21swapper/311:56:353
795199109,0cyclictest0-21swapper/211:06:182
795199109,0cyclictest0-21swapper/210:04:442
795199109,0cyclictest0-21swapper/209:44:042
7951991010,0cyclictest0-21swapper/210:20:532
7951991010,0cyclictest0-21swapper/210:20:532
7951991010,0cyclictest0-21swapper/210:16:422
7951991010,0cyclictest0-21swapper/208:10:262
795199100,0cyclictest0-21swapper/211:21:522
795099109,0cyclictest27176-21sshd09:40:401
795099109,0cyclictest0-21swapper/108:33:041
795099109,0cyclictest0-21swapper/107:12:541
795099109,0cyclictest0-21swapper/107:12:541
7950991010,0cyclictest0-21swapper/108:21:061
794999109,0cyclictest28638-21sshd11:32:470
794999109,0cyclictest0-21swapper/012:15:300
794999109,0cyclictest0-21swapper/011:41:220
7949991010,0cyclictest0-21swapper/010:49:130
794999100,0cyclictest0-21swapper/012:34:480
794999100,0cyclictest0-21swapper/011:00:280
41100,0ktimersoftd/09944-21id12:37:030
41100,0ktimersoftd/02944-21sshd11:05:250
41100,0ktimersoftd/013829-21bash09:53:220
110050100,0irq/25-eth00-21swapper/309:17:253
110050100,0irq/25-eth00-21swapper/011:22:090
995090,0irq/24-0000:00:0-21swapper/009:30:460
79529999,0cyclictest0-21swapper/308:54:243
79529999,0cyclictest0-21swapper/308:48:573
79529999,0cyclictest0-21swapper/308:01:343
79529999,0cyclictest0-21swapper/307:18:133
79529998,0cyclictest31984-21diskmemload10:35:353
79529998,0cyclictest18221-21sshd09:20:343
79529990,0cyclictest23915-21sshd12:38:363
79529990,0cyclictest0-21swapper/307:25:183
79519999,0cyclictest0-21swapper/211:52:392
79519999,0cyclictest0-21swapper/208:39:082
79519999,0cyclictest0-21swapper/208:20:182
79519999,0cyclictest0-21swapper/207:14:552
79519999,0cyclictest0-21swapper/207:14:542
79519998,0cyclictest0-21swapper/210:41:482
79519998,0cyclictest0-21swapper/209:36:162
79519990,0cyclictest0-21swapper/209:50:342
79509999,0cyclictest0-21swapper/111:15:281
79509999,0cyclictest0-21swapper/110:41:051
79509999,0cyclictest0-21swapper/108:40:441
79509999,0cyclictest0-21swapper/107:59:161
79509999,0cyclictest0-21swapper/107:49:021
79509999,0cyclictest0-21swapper/107:17:201
79509998,0cyclictest5976-21sshd12:19:141
79509998,0cyclictest0-21swapper/109:58:201
79509998,0cyclictest0-21swapper/108:36:261
79509991,0cyclictest0-21swapper/109:12:581
79509990,0cyclictest0-21swapper/108:52:001
79499992,0cyclictest0-21swapper/008:15:220
4190,0ktimersoftd/08787-21sshd09:56:150
4190,0ktimersoftd/07475-21sshd11:55:010
4190,0ktimersoftd/027970-21bash11:15:120
4190,0ktimersoftd/026771-21sshd12:00:270
4190,0ktimersoftd/02020-21sshd10:16:270
4190,0ktimersoftd/00-21swapper/009:20:270
19190,0ktimersoftd/10-21swapper/108:18:051
149990,0migration/03655-21bash10:41:040
149990,0migration/024895-21sshd09:25:320
11005090,0irq/25-eth028245-21fschecks_count10:05:210
11005090,0irq/25-eth028245-21fschecks_count10:05:200
11005090,0irq/25-eth02215-21perf11:30:003
11005090,0irq/25-eth020-21ksoftirqd/111:20:401
11005090,0irq/25-eth010330-21sshd12:02:101
11005090,0irq/25-eth00-21swapper/309:26:283
79529988,0cyclictest0-21swapper/308:27:003
79529988,0cyclictest0-21swapper/308:17:483
79529988,0cyclictest0-21swapper/307:24:093
79529987,0cyclictest0-21swapper/311:30:463
79519987,0cyclictest28-21ksoftirqd/209:10:382
79519987,0cyclictest0-21swapper/207:35:562
79519980,0cyclictest0-21swapper/209:01:462
79519980,0cyclictest0-21swapper/208:52:362
79509988,0cyclictest0-21swapper/108:12:311
79509987,0cyclictest0-21swapper/108:55:571
79509980,0cyclictest31984-21diskmemload09:15:091
79509980,0cyclictest0-21swapper/110:54:451
79499988,0cyclictest12599-21sshd10:35:100
79499988,0cyclictest0-21swapper/009:02:140
79499987,0cyclictest0-21swapper/008:29:280
159980,0watchdog/03344-21munin-node08:05:270
11005080,0irq/25-eth09809-21sshd10:48:481
11005080,0irq/25-eth06366-21sshd09:31:221
11005080,0irq/25-eth05236-21sshd10:30:443
11005080,0irq/25-eth036-21ksoftirqd/309:34:453
11005080,0irq/25-eth031984-21diskmemload09:24:591
11005080,0irq/25-eth028787-21sshd10:47:182
11005080,0irq/25-eth02104-21sshd10:26:583
11005080,0irq/25-eth010221-21sshd09:35:243
11005080,0irq/25-eth00-21swapper/309:47:383
11005080,0irq/25-eth00-21swapper/209:20:272
79529977,0cyclictest0-21swapper/308:06:473
79519977,0cyclictest0-21swapper/209:06:402
79519977,0cyclictest0-21swapper/208:03:552
79519977,0cyclictest0-21swapper/207:53:222
79519977,0cyclictest0-21swapper/207:45:342
79519977,0cyclictest0-21swapper/207:44:382
79519976,0cyclictest28-21ksoftirqd/212:05:202
79519973,0cyclictest0-21swapper/207:20:212
79519970,0cyclictest0-21swapper/208:55:232
79509977,0cyclictest0-21swapper/109:07:471
79509977,0cyclictest0-21swapper/108:49:331
79509977,0cyclictest0-21swapper/108:08:121
79499977,0cyclictest0-21swapper/007:29:460
79499976,0cyclictest0-21swapper/007:40:270
79499972,0cyclictest0-21swapper/007:20:220
79499970,0cyclictest0-21swapper/009:07:270
79499970,0cyclictest0-21swapper/007:57:030
79499970,0cyclictest0-21swapper/007:45:280
79499970,0cyclictest0-21swapper/007:30:260
11005070,0irq/25-eth029759-21sshd09:18:032
11005070,0irq/25-eth022682-21sshd12:00:052
11005070,0irq/25-eth020-21ksoftirqd/109:25:221
11005070,0irq/25-eth011662-21sshd10:55:522
11005070,0irq/25-eth00-21swapper/311:10:393
79529965,0cyclictest25250-21ls07:45:173
79529962,0cyclictest0-21swapper/309:05:253
79529962,0cyclictest0-21swapper/308:55:233
79529962,0cyclictest0-21swapper/307:55:163
79529962,0cyclictest0-21swapper/307:35:163
79519966,0cyclictest0-21swapper/208:30:112
79519966,0cyclictest0-21swapper/207:31:522
79519965,0cyclictest0-21swapper/207:55:132
79519962,0cyclictest0-21swapper/208:45:252
79519962,0cyclictest0-21swapper/208:40:232
79519962,0cyclictest0-21swapper/208:15:232
79519962,0cyclictest0-21swapper/208:05:222
79509966,0cyclictest0-21swapper/107:24:321
79509965,0cyclictest24221-21unixbench_multi07:40:241
79509962,0cyclictest0-21swapper/107:35:171
79499965,0cyclictest20724-21cpuspeed_turbos08:45:190
79499962,0cyclictest0-21swapper/008:50:240
79499962,0cyclictest0-21swapper/008:35:220
79499962,0cyclictest0-21swapper/008:10:160
79499962,0cyclictest0-21swapper/008:00:190
79499962,0cyclictest0-21swapper/007:50:190
79499962,0cyclictest0-21swapper/007:15:010
79499962,0cyclictest0-21swapper/007:10:200
79499962,0cyclictest0-21swapper/007:10:190
329960,0watchdog/327556-21wget09:00:193
11795060,0irq/26-eth1-rx-0-21swapper/107:28:431
11005060,0irq/25-eth00-21swapper/008:55:170
79529954,0cyclictest17890-21latency_hist07:30:013
79509950,0cyclictest0-21swapper/109:00:241
79499950,0cyclictest0-21swapper/008:40:240
79499950,0cyclictest0-21swapper/007:35:130
259950,0migration/212367-21nfsd408:25:252
149950,0migration/09616-21fschecks_time08:20:210
11795050,0irq/26-eth1-rx-19373-21kworker/3:108:35:013
11795050,0irq/26-eth1-rx-0-21swapper/108:00:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional