You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-27 - 03:57

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.4.39-rt50+ (Profile)

Latency plot of system in rack #7, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack7slot0.osadl.org (updated Mon Jun 27, 2022 00:44:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117950640,0irq/26-eth1-rx-0-21swapper/319:09:093
110050580,0irq/25-eth00-21swapper/119:06:031
110050570,0irq/25-eth00-21swapper/219:06:542
791724522,0sleep00-21swapper/019:06:490
843099180,0cyclictest28856-21gawk21:00:163
842899180,0cyclictest0-21swapper/122:21:301
110050160,0irq/25-eth020-21ksoftirqd/100:33:591
8430991514,0cyclictest0-21swapper/323:03:513
843099150,0cyclictest0-21swapper/323:07:563
8428991514,0cyclictest0-21swapper/100:04:321
8427991513,0cyclictest0-21swapper/022:37:570
8430991413,0cyclictest0-21swapper/322:48:383
8430991412,0cyclictest12656-21munin-run21:50:003
8429991412,0cyclictest0-21swapper/221:57:592
842999140,0cyclictest7596-21bash21:49:232
842999140,0cyclictest0-21swapper/223:29:522
842999140,0cyclictest0-21swapper/222:26:542
8428991413,0cyclictest0-21swapper/122:35:341
8428991412,0cyclictest0-21swapper/100:16:161
842899140,0cyclictest0-21swapper/122:55:041
8427991413,0cyclictest0-21swapper/021:50:190
842799140,0cyclictest0-21swapper/022:00:050
110050140,0irq/25-eth00-21swapper/323:31:443
8430991312,0cyclictest5334-21bash21:41:173
8430991312,0cyclictest0-21swapper/323:12:003
8430991312,0cyclictest0-21swapper/322:30:183
8430991311,0cyclictest0-21swapper/300:17:023
8429991312,0cyclictest0-21swapper/223:56:342
8428991312,0cyclictest0-21swapper/123:54:321
8428991312,0cyclictest0-21swapper/123:45:431
8428991312,0cyclictest0-21swapper/123:27:141
8428991310,0cyclictest31887-21sshd22:50:121
842899130,0cyclictest32071-21sshd00:27:461
842899130,0cyclictest0-21swapper/123:56:331
842899130,0cyclictest0-21swapper/121:30:301
8427991312,0cyclictest23725-21sshd22:25:520
8427991312,0cyclictest0-21swapper/022:59:480
8427991312,0cyclictest0-21swapper/021:21:380
8427991311,0cyclictest0-21swapper/000:22:230
842799130,0cyclictest0-21swapper/000:35:380
41130,0ktimersoftd/00-21swapper/022:42:300
41130,0ktimersoftd/00-21swapper/021:14:050
110050130,0irq/25-eth07084-21bash21:53:083
110050130,0irq/25-eth00-21swapper/323:59:233
110050130,0irq/25-eth00-21swapper/300:11:503
110050130,0irq/25-eth00-21swapper/200:17:022
8430991211,0cyclictest25417-21sshd23:28:013
8430991211,0cyclictest19363-21bash21:58:273
8430991211,0cyclictest10975-21sshd21:15:083
8430991211,0cyclictest0-21swapper/323:54:443
8430991211,0cyclictest0-21swapper/323:35:213
8430991211,0cyclictest0-21swapper/322:59:003
8430991210,0cyclictest8003-21sshd22:27:583
8430991210,0cyclictest0-21swapper/300:24:423
843099120,0cyclictest2624-21sshd23:48:313
843099120,0cyclictest0-21swapper/322:09:573
843099120,0cyclictest0-21swapper/321:37:333
843099120,0cyclictest0-21swapper/320:55:153
843099120,0cyclictest0-21swapper/300:35:133
8429991212,0cyclictest0-21swapper/222:02:512
8429991211,0cyclictest8241-21sshd22:16:202
8429991211,0cyclictest0-21swapper/223:02:142
8429991211,0cyclictest0-21swapper/222:57:202
8429991210,0cyclictest29122-21sshd23:51:362
8429991210,0cyclictest0-21swapper/223:37:452
8429991210,0cyclictest0-21swapper/220:46:182
842999120,0cyclictest11542-21sshd21:53:402
842999120,0cyclictest0-21swapper/223:23:072
842999120,0cyclictest0-21swapper/222:52:272
842999120,0cyclictest0-21swapper/221:32:112
8428991211,0cyclictest14238-21sensors_fan22:05:281
8428991211,0cyclictest0-21swapper/122:14:381
8428991211,0cyclictest0-21swapper/122:00:361
842899120,0cyclictest20557-21sshd22:25:291
842899120,0cyclictest0-21swapper/122:40:261
842899120,0cyclictest0-21swapper/121:56:171
842899120,0cyclictest0-21swapper/121:51:591
842899120,0cyclictest0-21swapper/100:10:421
8427991211,0cyclictest20241-21sshd00:26:140
8427991211,0cyclictest0-21swapper/022:22:090
8427991211,0cyclictest0-21swapper/021:27:050
8427991211,0cyclictest0-21swapper/000:03:350
8427991210,0cyclictest0-21swapper/023:54:090
8427991210,0cyclictest0-21swapper/022:11:000
8427991210,0cyclictest0-21swapper/000:09:080
842799120,0cyclictest0-21swapper/023:37:060
842799120,0cyclictest0-21swapper/022:15:190
191120,0ktimersoftd/10-21swapper/123:42:001
110050120,0irq/25-eth027339-21sshd21:28:352
110050120,0irq/25-eth00-21swapper/022:49:200
843099119,0cyclictest9568-21sshd00:32:573
843099119,0cyclictest0-21swapper/321:21:453
8430991111,0cyclictest0-21swapper/323:41:293
8430991110,0cyclictest32461-21diskmemload21:26:383
8430991110,0cyclictest18210-21sshd23:15:283
8430991110,0cyclictest0-21swapper/322:43:473
8430991110,0cyclictest0-21swapper/322:17:243
8430991110,0cyclictest0-21swapper/322:03:553
842999119,0cyclictest30204-21bash23:16:592
842999119,0cyclictest10755-21bash21:11:062
842999119,0cyclictest0-21swapper/220:07:372
8429991111,0cyclictest0-21swapper/223:30:262
8429991111,0cyclictest0-21swapper/222:23:122
8429991110,0cyclictest30074-21id22:42:072
8429991110,0cyclictest0-21swapper/223:47:102
8429991110,0cyclictest0-21swapper/222:32:562
8429991110,0cyclictest0-21swapper/221:21:162
8429991110,0cyclictest0-21swapper/219:31:092
8429991110,0cyclictest0-21swapper/200:07:442
842999110,0cyclictest26065-21sshd22:37:492
842999110,0cyclictest1512-21sshd23:41:432
842999110,0cyclictest0-21swapper/222:49:102
842999110,0cyclictest0-21swapper/219:24:382
8428991111,0cyclictest1469-21sshd00:20:071
8428991111,0cyclictest0-21swapper/120:25:141
8428991111,0cyclictest0-21swapper/119:48:301
8428991110,0cyclictest16435-21sshd21:11:481
8428991110,0cyclictest14930-21sshd23:34:351
8428991110,0cyclictest0-21swapper/121:35:231
8428991110,0cyclictest0-21swapper/121:24:271
8428991110,0cyclictest0-21swapper/119:28:461
842899110,0cyclictest0-21swapper/121:02:521
842899110,0cyclictest0-21swapper/120:18:291
8427991111,0cyclictest0-21swapper/020:51:120
8427991111,0cyclictest0-21swapper/000:30:030
8427991110,0cyclictest0-21swapper/022:33:050
842799110,0cyclictest0-21swapper/019:55:330
842799110,0cyclictest0-21swapper/019:30:130
41110,0ktimersoftd/025406-21sshd21:35:550
41110,0ktimersoftd/013043-21bash23:57:290
41110,0ktimersoftd/00-21swapper/021:47:470
271110,0ktimersoftd/20-21swapper/219:42:462
271110,0ktimersoftd/20-21swapper/200:14:352
1599110,0watchdog/016533-21sshd23:19:190
110050110,0irq/25-eth05983-21sshd23:48:570
110050110,0irq/25-eth028701-21sshd23:32:150
110050110,0irq/25-eth00-21swapper/322:37:083
843099109,0cyclictest0-21swapper/300:05:533
843099105,0cyclictest22317-21sshd00:02:363
8430991010,0cyclictest0-21swapper/322:53:313
8430991010,0cyclictest0-21swapper/321:31:563
842999109,0cyclictest0-21swapper/223:07:292
842999109,0cyclictest0-21swapper/221:40:472
842999109,0cyclictest0-21swapper/221:37:042
842999109,0cyclictest0-21swapper/200:22:082
8429991010,0cyclictest0-21swapper/221:06:172
8429991010,0cyclictest0-21swapper/220:43:592
8429991010,0cyclictest0-21swapper/219:47:382
8429991010,0cyclictest0-21swapper/219:27:532
8429991010,0cyclictest0-21swapper/200:38:512
842999100,0cyclictest23446-21bash21:16:272
842999100,0cyclictest0-21swapper/220:26:402
842899109,0cyclictest16273-21sshd21:19:361
842899109,0cyclictest0-21swapper/121:43:241
8428991010,0cyclictest0-21swapper/121:29:561
8428991010,0cyclictest0-21swapper/120:42:311
8428991010,0cyclictest0-21swapper/119:32:011
8428991010,0cyclictest0-21swapper/100:37:061
842899100,0cyclictest0-21swapper/121:47:411
842899100,0cyclictest0-21swapper/119:12:301
842799109,0cyclictest28474-21sshd00:15:180
842799109,0cyclictest21515-21sshd21:31:410
842799109,0cyclictest0-21swapper/019:45:480
842799105,0cyclictest0-21swapper/020:00:130
8427991010,0cyclictest0-21swapper/023:24:470
8427991010,0cyclictest0-21swapper/021:15:010
842799100,0cyclictest0-21swapper/022:06:420
842799100,0cyclictest0-21swapper/020:55:140
842799100,0cyclictest0-21swapper/019:25:210
41100,0ktimersoftd/031914-21nfsd423:40:180
41100,0ktimersoftd/012494-21strings19:15:180
41100,0ktimersoftd/00-21swapper/022:52:340
271100,0ktimersoftd/20-21swapper/219:57:102
110050100,0irq/25-eth00-21swapper/222:07:162
110050100,0irq/25-eth00-21swapper/122:46:421
110050100,0irq/25-eth00-21swapper/023:03:310
84309999,0cyclictest0-21swapper/322:24:153
84309998,0cyclictest0-21swapper/323:20:083
84309990,0cyclictest7138-21sshd21:10:393
84309990,0cyclictest0-21swapper/322:10:003
84299999,0cyclictest0-21swapper/220:19:562
84299999,0cyclictest0-21swapper/219:19:182
84299999,0cyclictest0-21swapper/219:10:282
84299999,0cyclictest0-21swapper/200:25:582
84299998,0cyclictest0-21swapper/219:38:492
84299990,0cyclictest0-21swapper/222:12:422
84289999,0cyclictest0-21swapper/120:55:181
84289999,0cyclictest0-21swapper/119:57:551
84289999,0cyclictest0-21swapper/119:35:511
84289999,0cyclictest0-21swapper/119:20:101
84289998,0cyclictest0-21swapper/123:06:001
84289998,0cyclictest0-21swapper/120:31:221
84289998,0cyclictest0-21swapper/100:05:071
84289995,0cyclictest0-21swapper/123:35:161
84289990,0cyclictest0-21swapper/120:36:221
84289990,0cyclictest0-21swapper/119:50:201
84279999,0cyclictest9140-21sshd21:41:450
84279999,0cyclictest0-21swapper/020:37:080
84279999,0cyclictest0-21swapper/020:25:040
84279999,0cyclictest0-21swapper/020:16:140
84279999,0cyclictest0-21swapper/020:12:240
84279999,0cyclictest0-21swapper/020:12:240
84279990,0cyclictest0-21swapper/023:11:130
4190,0ktimersoftd/00-21swapper/021:55:120
4190,0ktimersoftd/00-21swapper/020:20:150
4190,0ktimersoftd/00-21swapper/000:12:230
11795090,0irq/26-eth1-rx-0-21swapper/123:18:311
11795090,0irq/26-eth1-rx-0-21swapper/123:10:541
84309980,0cyclictest0-21swapper/300:25:363
84299988,0cyclictest0-21swapper/220:02:372
84299988,0cyclictest0-21swapper/200:30:242
84299988,0cyclictest0-21swapper/200:02:092
84299980,0cyclictest0-21swapper/220:55:112
84289988,0cyclictest0-21swapper/120:54:081
84289988,0cyclictest0-21swapper/119:44:061
84289987,0cyclictest0-21swapper/120:12:541
84289987,0cyclictest0-21swapper/120:12:541
84289980,0cyclictest0-21swapper/119:15:021
84279984,0cyclictest9610-21awk19:10:180
84279984,0cyclictest0-21swapper/020:40:160
84279980,0cyclictest0-21swapper/021:05:170
84279980,0cyclictest0-21swapper/019:40:200
4180,0ktimersoftd/02191-21ls23:25:180
4180,0ktimersoftd/00-21swapper/019:38:170
19180,0ktimersoftd/127694-21bash23:20:281
159980,0watchdog/06502-21sshd23:06:230
11005080,0irq/25-eth031917-21cstates22:15:241
84309977,0cyclictest0-21swapper/320:37:293
84309973,0cyclictest0-21swapper/321:05:173
84309970,0cyclictest0-21swapper/320:48:113
84299977,0cyclictest0-21swapper/220:32:502
84299977,0cyclictest0-21swapper/220:13:462
84299977,0cyclictest0-21swapper/220:13:462
84289977,0cyclictest0-21swapper/120:02:551
84289973,0cyclictest0-21swapper/122:30:161
84289973,0cyclictest0-21swapper/120:45:211
84279977,0cyclictest0-21swapper/020:33:180
149970,0migration/014375-21fschecks_time19:20:140
11005070,0irq/25-eth020-21ksoftirqd/123:00:261
11005070,0irq/25-eth013331-21sshd23:11:052
11005070,0irq/25-eth00-21swapper/020:05:150
84309965,0cyclictest30292-21expr19:55:113
84309965,0cyclictest24575-21ntp_offset20:50:193
84309965,0cyclictest178392chrt19:25:423
84309962,0cyclictest0-21swapper/320:40:153
84309962,0cyclictest0-21swapper/320:30:163
84309962,0cyclictest0-21swapper/320:25:153
84309962,0cyclictest0-21swapper/320:20:203
84309962,0cyclictest0-21swapper/320:15:153
84309962,0cyclictest0-21swapper/320:10:163
84309962,0cyclictest0-21swapper/320:10:153
84309962,0cyclictest0-21swapper/320:05:153
84309962,0cyclictest0-21swapper/320:00:153
84309962,0cyclictest0-21swapper/319:50:153
84309962,0cyclictest0-21swapper/319:45:173
84309962,0cyclictest0-21swapper/319:40:143
84309962,0cyclictest0-21swapper/319:20:163
84309962,0cyclictest0-21swapper/319:15:023
84309961,0cyclictest0-21swapper/319:35:153
84309960,0cyclictest0-21swapper/319:11:463
84299962,0cyclictest0-21swapper/220:50:152
84299962,0cyclictest0-21swapper/220:35:152
84299962,0cyclictest0-21swapper/220:20:202
84299961,0cyclictest0-21swapper/219:50:152
84289962,0cyclictest0-21swapper/120:05:161
84289961,0cyclictest0-21swapper/121:05:161
84279963,0cyclictest29092-21nfsd421:00:180
84279962,0cyclictest0-21swapper/020:45:200
4160,0ktimersoftd/00-21swapper/019:50:170
259960,0migration/229720-21munin-node21:00:242
84309954,0cyclictest18691-21expr19:30:133
84289950,0cyclictest0-21swapper/120:20:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional