You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-05-29 - 14:26

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.4.39-rt50+ (Profile)

Latency plot of system in rack #7, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack7slot0.osadl.org (updated Sun May 29, 2022 12:45:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
110050590,0irq/25-eth00-21swapper/307:09:493
110050580,0irq/25-eth00-21swapper/107:07:121
110050550,0irq/25-eth00-21swapper/207:05:202
110050400,0irq/25-eth00-21swapper/007:05:130
110050330,0irq/25-eth00-21swapper/107:10:011
117950190,0irq/26-eth1-rx-0-21swapper/307:10:013
110050190,0irq/25-eth028-21ksoftirqd/211:22:062
4170991716,0cyclictest0-21swapper/008:20:150
4173991513,0cyclictest0-21swapper/311:45:033
4173991512,0cyclictest0-21swapper/310:27:273
4173991511,0cyclictest0-21swapper/309:29:503
4172991514,0cyclictest13311-21sshd09:19:062
4171991513,0cyclictest28199-21diskmemload11:45:481
4170991514,0cyclictest0-21swapper/011:28:040
4170991511,0cyclictest0-21swapper/009:40:580
417399149,0cyclictest18280-21sshd11:29:433
4173991413,0cyclictest0-21swapper/309:52:083
4173991411,0cyclictest0-21swapper/309:36:343
4173991410,0cyclictest4639-21sshd09:43:193
4172991414,0cyclictest788-40kipmi010:50:172
4172991413,0cyclictest17897-21sshd10:24:372
4172991411,0cyclictest0-21swapper/210:56:472
417299140,0cyclictest0-21swapper/212:11:572
417299140,0cyclictest0-21swapper/211:44:532
4171991411,0cyclictest0-21swapper/111:41:591
417199140,0cyclictest0-21swapper/112:13:271
417199140,0cyclictest0-21swapper/111:22:131
417199140,0cyclictest0-21swapper/110:35:131
417199140,0cyclictest0-21swapper/110:35:121
4170991413,0cyclictest0-21swapper/012:30:130
4170991413,0cyclictest0-21swapper/012:02:340
4170991411,0cyclictest0-21swapper/010:48:280
4170991411,0cyclictest0-21swapper/010:48:280
417099140,0cyclictest15259-21sshd10:13:230
110050140,0irq/25-eth00-21swapper/311:09:103
4173991312,0cyclictest12177-21sshd10:49:173
4173991312,0cyclictest12177-21sshd10:49:173
4173991312,0cyclictest0-21swapper/312:40:003
4173991312,0cyclictest0-21swapper/312:34:263
4173991312,0cyclictest0-21swapper/312:23:173
4173991312,0cyclictest0-21swapper/310:22:273
4173991312,0cyclictest0-21swapper/310:17:283
4173991310,0cyclictest110050irq/25-eth009:15:123
4173991310,0cyclictest0-21swapper/311:41:143
417399130,0cyclictest31387-21sshd10:36:533
417399130,0cyclictest31387-21sshd10:36:523
417399130,0cyclictest0-21swapper/310:00:233
4172991312,0cyclictest0-21swapper/210:03:072
4172991311,0cyclictest0-21swapper/211:00:032
4172991311,0cyclictest0-21swapper/210:15:122
4171991312,0cyclictest1936-21sshd09:50:141
4171991312,0cyclictest1453-21nfsd09:40:151
4171991311,0cyclictest28199-21diskmemload11:34:181
417199130,0cyclictest0-21swapper/109:45:481
4170991312,0cyclictest0-21swapper/012:25:130
4170991312,0cyclictest0-21swapper/009:22:300
4170991311,0cyclictest0-21swapper/012:35:140
4170991311,0cyclictest0-21swapper/012:20:150
4170991311,0cyclictest0-21swapper/010:05:440
417099130,0cyclictest0-21swapper/010:31:380
110050130,0irq/25-eth00-21swapper/110:07:591
417399129,0cyclictest25758-21sshd11:59:283
4173991212,0cyclictest0-21swapper/311:54:273
4173991211,0cyclictest5023-21bash10:08:393
4173991211,0cyclictest0-21swapper/312:18:163
4173991211,0cyclictest0-21swapper/310:32:273
417399120,0cyclictest28199-21diskmemload09:14:373
417399120,0cyclictest22029-21sshd09:55:593
417399120,0cyclictest0-21swapper/312:08:173
417399120,0cyclictest0-21swapper/311:36:483
417399120,0cyclictest0-21swapper/308:10:443
4172991212,0cyclictest0-21swapper/211:18:032
4172991212,0cyclictest0-21swapper/211:10:232
4172991211,0cyclictest5164-21sshd09:50:272
4172991211,0cyclictest0-21swapper/210:44:222
4172991211,0cyclictest0-21swapper/210:35:112
4172991211,0cyclictest0-21swapper/210:35:112
4172991211,0cyclictest0-21swapper/210:29:362
4172991211,0cyclictest0-21swapper/209:46:372
4172991210,0cyclictest0-21swapper/212:33:052
4172991210,0cyclictest0-21swapper/209:11:472
417299120,0cyclictest27995-21sshd12:21:212
417299120,0cyclictest25219-21sshd09:27:342
417299120,0cyclictest0-21swapper/211:49:182
417299120,0cyclictest0-21swapper/211:37:142
4171991212,0cyclictest0-21swapper/112:23:261
4171991212,0cyclictest0-21swapper/110:29:581
4171991211,0cyclictest28199-21diskmemload10:47:581
4171991211,0cyclictest28199-21diskmemload10:47:571
4171991211,0cyclictest0-21swapper/111:00:581
4171991211,0cyclictest0-21swapper/110:51:131
4171991210,0cyclictest0-21swapper/112:18:271
4171991210,0cyclictest0-21swapper/111:11:181
417199120,0cyclictest0-21swapper/112:39:351
417199120,0cyclictest0-21swapper/111:59:371
417199120,0cyclictest0-21swapper/111:18:241
4170991211,0cyclictest9508-21sshd10:27:120
4170991211,0cyclictest0-21swapper/011:00:530
4170991210,0cyclictest0-21swapper/012:11:250
4170991210,0cyclictest0-21swapper/008:53:480
417099120,0cyclictest0-21swapper/011:24:150
417099120,0cyclictest0-21swapper/010:54:230
417099120,0cyclictest0-21swapper/010:01:530
417099120,0cyclictest0-21swapper/007:35:170
41120,0ktimersoftd/00-21swapper/012:18:240
41120,0ktimersoftd/00-21swapper/010:17:200
191120,0ktimersoftd/10-21swapper/110:20:531
110050120,0irq/25-eth0775-21kworker/3:211:00:063
110050120,0irq/25-eth0775-21kworker/3:210:44:183
110050120,0irq/25-eth06046-21sshd10:59:271
110050120,0irq/25-eth028830-21bash09:45:540
4173991111,0cyclictest0-21swapper/312:13:173
417399111,0cyclictest0-21swapper/310:50:073
4173991110,0cyclictest0-21swapper/312:28:503
4173991110,0cyclictest0-21swapper/310:13:033
417399110,0cyclictest5346-21consoletype11:20:543
417399110,0cyclictest23514-21munin-run09:00:003
417399110,0cyclictest2259-21sshd09:21:213
417399110,0cyclictest0-21swapper/307:56:193
4172991111,0cyclictest0-21swapper/212:07:322
4172991111,0cyclictest0-21swapper/212:03:082
4172991111,0cyclictest0-21swapper/210:06:572
4172991110,0cyclictest0-21swapper/212:38:402
4172991110,0cyclictest0-21swapper/212:27:312
417299110,0cyclictest16176-21sshd11:25:432
417299110,0cyclictest0-21swapper/211:33:232
417199111,0cyclictest10886-21rm11:54:101
4171991110,0cyclictest306-21sshd12:00:121
4171991110,0cyclictest23171-21consoletype09:27:201
4171991110,0cyclictest0-21swapper/112:29:351
4171991110,0cyclictest0-21swapper/110:30:311
4171991110,0cyclictest0-21swapper/109:59:031
4171991110,0cyclictest0-21swapper/109:33:291
4171991110,0cyclictest0-21swapper/108:01:291
417199110,0cyclictest10615-21sshd12:34:011
417199110,0cyclictest0-21swapper/108:13:271
417199110,0cyclictest0-21swapper/107:41:511
417099119,0cyclictest0-21swapper/011:54:190
4170991111,0cyclictest32006-21sshd11:38:240
4170991111,0cyclictest110050irq/25-eth009:58:040
4170991111,0cyclictest0-21swapper/011:13:540
4170991111,0cyclictest0-21swapper/010:57:390
4170991110,0cyclictest0-21swapper/011:49:550
4170991110,0cyclictest0-21swapper/009:10:460
417099110,0cyclictest19794-21sshd09:34:150
41110,0ktimersoftd/022718-21sshd10:35:520
41110,0ktimersoftd/022718-21sshd10:35:510
110050110,0irq/25-eth028418-21sshd11:52:262
110050110,0irq/25-eth00-21swapper/209:56:582
110050110,0irq/25-eth00-21swapper/209:32:412
110050110,0irq/25-eth00-21swapper/109:24:541
110050110,0irq/25-eth00-21swapper/011:15:350
9950100,0irq/24-0000:00:0-21swapper/111:05:011
9950100,0irq/24-0000:00:0-21swapper/010:40:410
417399109,0cyclictest0-21swapper/311:17:383
417399102,0cyclictest0-21swapper/312:00:153
417399102,0cyclictest0-21swapper/311:10:233
4173991010,0cyclictest0-21swapper/309:09:033
417399100,0cyclictest0-21swapper/308:01:193
417399100,0cyclictest0-21swapper/307:35:043
417399100,0cyclictest0-21swapper/307:29:433
417299109,0cyclictest0-21swapper/209:41:382
4172991010,0cyclictest0-21swapper/212:16:562
4172991010,0cyclictest0-21swapper/207:24:542
417299100,0cyclictest7324-21sshd10:45:092
417299100,0cyclictest7324-21sshd10:45:082
417299100,0cyclictest0-21swapper/210:10:572
417199109,0cyclictest28199-21diskmemload10:40:391
417199109,0cyclictest0-21swapper/111:26:391
417199109,0cyclictest0-21swapper/108:51:061
417199109,0cyclictest0-21swapper/108:29:291
417199109,0cyclictest0-21swapper/107:16:181
4171991010,0cyclictest0-21swapper/112:09:031
4171991010,0cyclictest0-21swapper/110:15:331
4171991010,0cyclictest0-21swapper/109:12:071
4171991010,0cyclictest0-21swapper/108:41:281
4171991010,0cyclictest0-21swapper/108:30:041
4171991010,0cyclictest0-21swapper/107:53:351
4171991010,0cyclictest0-21swapper/107:34:461
4171991010,0cyclictest0-21swapper/107:28:161
417199100,0cyclictest0-21swapper/109:36:351
417199100,0cyclictest0-21swapper/107:38:011
417099109,0cyclictest0-21swapper/008:45:540
4170991010,0cyclictest0-21swapper/009:53:380
4170991010,0cyclictest0-21swapper/008:30:410
4170991010,0cyclictest0-21swapper/007:22:300
417099100,0cyclictest788-40kipmi009:15:180
417099100,0cyclictest0-21swapper/011:58:040
41100,0ktimersoftd/022057-21sshd09:27:120
41100,0ktimersoftd/00-21swapper/011:09:200
351100,0ktimersoftd/30-21swapper/308:33:553
110050100,0irq/25-eth021260-21bash11:33:370
110050100,0irq/25-eth00-21swapper/012:06:570
41739999,0cyclictest0-21swapper/309:02:533
41739999,0cyclictest0-21swapper/308:16:533
41739992,0cyclictest0-21swapper/307:40:193
41739990,0cyclictest0-21swapper/309:30:393
41739990,0cyclictest0-21swapper/307:48:053
41739990,0cyclictest0-21swapper/307:32:243
41729999,0cyclictest0-21swapper/211:58:422
41729999,0cyclictest0-21swapper/208:40:112
41729990,0cyclictest0-21swapper/211:05:282
41729990,0cyclictest0-21swapper/208:53:462
41729990,0cyclictest0-21swapper/208:29:162
41719999,0cyclictest0-21swapper/110:11:081
41719999,0cyclictest0-21swapper/109:18:521
41719999,0cyclictest0-21swapper/109:03:031
41719998,0cyclictest0-21swapper/110:03:281
41719990,0cyclictest0-21swapper/108:15:181
41709999,0cyclictest0-21swapper/010:22:470
41709999,0cyclictest0-21swapper/008:10:500
41709999,0cyclictest0-21swapper/008:03:310
41709999,0cyclictest0-21swapper/007:46:470
41709990,0cyclictest0-21swapper/009:02:170
41709990,0cyclictest0-21swapper/008:55:220
27190,0ktimersoftd/20-21swapper/208:33:542
11005090,0irq/25-eth02413-21sshd11:31:263
41739988,0cyclictest0-21swapper/308:06:203
41739987,0cyclictest0-21swapper/309:45:063
41739987,0cyclictest0-21swapper/308:24:123
41739982,0cyclictest9526-21munin-run08:30:003
41739982,0cyclictest0-21swapper/308:45:153
41739980,0cyclictest0-21swapper/310:55:183
41739980,0cyclictest0-21swapper/307:50:163
41729987,0cyclictest0-21swapper/209:35:052
41729987,0cyclictest0-21swapper/208:10:072
41719988,0cyclictest0-21swapper/107:21:251
41709988,0cyclictest0-21swapper/011:42:140
41709988,0cyclictest0-21swapper/007:51:470
41709988,0cyclictest0-21swapper/007:42:220
41709988,0cyclictest0-21swapper/007:32:370
41709983,0cyclictest0-21swapper/009:35:230
41709981,0cyclictest0-21swapper/009:05:160
41709980,0cyclictest0-21swapper/008:35:130
35180,0ktimersoftd/30-21swapper/307:22:523
11005080,0irq/25-eth09617-21sshd11:35:481
11005080,0irq/25-eth00-21swapper/008:17:190
41739977,0cyclictest0-21swapper/308:43:503
41729977,0cyclictest0-21swapper/207:51:442
41729970,0cyclictest0-21swapper/208:55:162
41729970,0cyclictest0-21swapper/208:06:502
41719977,0cyclictest0-21swapper/107:48:011
41709970,0cyclictest0-21swapper/008:40:160
259970,0migration/26272-21nfsd408:20:182
159970,0watchdog/08652-21ntp_offset08:25:190
11795070,0irq/26-eth1-rx-26578-21hddtemp_smartct07:55:151
11005070,0irq/25-eth03315-21sshd09:21:292
11005070,0irq/25-eth028199-21diskmemload10:31:382
11005070,0irq/25-eth00-21swapper/007:19:520
41739962,0cyclictest0-21swapper/308:50:153
41739962,0cyclictest0-21swapper/307:15:163
41739960,0cyclictest0-21swapper/308:35:153
41729966,0cyclictest0-21swapper/208:03:352
41729962,0cyclictest0-21swapper/209:00:162
41729962,0cyclictest0-21swapper/208:45:152
41729962,0cyclictest0-21swapper/208:35:162
41729962,0cyclictest0-21swapper/208:15:162
41729962,0cyclictest0-21swapper/207:45:162
41729962,0cyclictest0-21swapper/207:40:182
41729962,0cyclictest0-21swapper/207:35:162
41729962,0cyclictest0-21swapper/207:30:162
41729962,0cyclictest0-21swapper/207:25:162
41729962,0cyclictest0-21swapper/207:15:012
41719965,0cyclictest30264-21latency_hist08:05:001
41719965,0cyclictest26051-21latency_hist09:05:001
41719965,0cyclictest16996-21cpuspeed_turbos08:45:111
41719962,0cyclictest0-21swapper/108:35:151
41709962,0cyclictest0-21swapper/007:55:160
41709962,0cyclictest0-21swapper/007:25:150
159960,0watchdog/05002-21if_err_eth107:10:150
41729953,0cyclictest0-21swapper/207:13:532
41729951,0cyclictest0-21swapper/207:55:162
41729950,0cyclictest0-21swapper/209:05:162
41719950,0cyclictest0-21swapper/108:20:011
41709954,0cyclictest0-21swapper/008:05:190
11795050,0irq/26-eth1-rx-0-21swapper/108:55:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional