You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-20 - 23:56

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.4.39-rt50+ (Profile)

Latency plot of system in rack #7, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack7slot0.osadl.org (updated Mon Mar 20, 2023 12:44:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117950640,0irq/26-eth1-rx-0-21swapper/107:06:421
117950570,0irq/26-eth1-rx-0-21swapper/307:07:303
587624521,0sleep00-21swapper/007:09:380
381124421,0sleep20-21swapper/207:05:122
6164992217,0cyclictest0-21swapper/110:19:511
6164991918,0cyclictest16317-21id12:30:271
616699160,0cyclictest0-21swapper/312:15:253
6163991514,0cyclictest0-21swapper/010:43:360
110050150,0irq/25-eth00-21swapper/110:05:191
6166991413,0cyclictest5035-21sshd11:18:233
616699140,0cyclictest17554-21sshd11:33:573
616699140,0cyclictest17554-21sshd11:33:573
6165991413,0cyclictest0-21swapper/209:59:102
6165991412,0cyclictest0-21swapper/211:58:212
6164991412,0cyclictest39472chrt11:46:371
616399140,0cyclictest5652-21sshd12:36:250
616399140,0cyclictest16012-21sshd11:12:240
616399140,0cyclictest0-21swapper/010:16:120
110050140,0irq/25-eth00-21swapper/309:17:283
6166991312,0cyclictest0-21swapper/311:37:053
6166991312,0cyclictest0-21swapper/311:37:053
6166991312,0cyclictest0-21swapper/310:29:573
6166991312,0cyclictest0-21swapper/310:21:493
6166991312,0cyclictest0-21swapper/309:54:593
6166991312,0cyclictest0-21swapper/309:39:043
6166991311,0cyclictest0-21swapper/311:23:373
6165991312,0cyclictest21810-21sshd10:12:462
6165991312,0cyclictest0-21swapper/210:25:252
616599130,0cyclictest0-21swapper/211:10:232
6164991312,0cyclictest8-21rcu_preempt09:22:521
6164991312,0cyclictest30185-21diskmemload12:08:341
6164991312,0cyclictest18216-21sshd12:37:511
6164991312,0cyclictest0-21swapper/110:24:571
6164991311,0cyclictest0-21swapper/111:36:171
6164991311,0cyclictest0-21swapper/111:36:171
6164991311,0cyclictest0-21swapper/109:38:351
6164991311,0cyclictest0-21swapper/109:13:171
616499130,0cyclictest0-21swapper/112:20:531
616499130,0cyclictest0-21swapper/111:55:411
616499130,0cyclictest0-21swapper/110:40:311
6163991312,0cyclictest0-21swapper/010:56:370
6163991312,0cyclictest0-21swapper/009:29:500
6163991312,0cyclictest0-21swapper/009:16:090
6163991311,0cyclictest0-21swapper/010:13:110
616399130,0cyclictest0-21swapper/011:43:330
616399130,0cyclictest0-21swapper/009:41:130
616399130,0cyclictest0-21swapper/008:55:210
110050130,0irq/25-eth032612-21kworker/3:211:59:213
6166991211,0cyclictest0-21swapper/312:34:353
6166991211,0cyclictest0-21swapper/312:01:293
6166991211,0cyclictest0-21swapper/311:52:253
6166991211,0cyclictest0-21swapper/311:11:173
6166991210,0cyclictest0-21swapper/311:40:143
616699120,0cyclictest28711-21sshd10:34:503
616699120,0cyclictest0-21swapper/312:37:443
616699120,0cyclictest0-21swapper/311:01:263
616699120,0cyclictest0-21swapper/310:35:453
6165991212,0cyclictest0-21swapper/212:01:292
6165991211,0cyclictest20898-21bash11:09:272
6165991211,0cyclictest17435-21bash10:15:452
6165991211,0cyclictest0-21swapper/209:50:282
6165991211,0cyclictest0-21swapper/209:41:452
6165991210,0cyclictest0-21swapper/210:46:342
616599120,0cyclictest30572-21sshd11:31:452
616599120,0cyclictest30572-21sshd11:31:452
616599120,0cyclictest0-21swapper/212:25:482
616599120,0cyclictest0-21swapper/212:09:232
616599120,0cyclictest0-21swapper/211:52:262
616599120,0cyclictest0-21swapper/209:33:572
6164991212,0cyclictest110050irq/25-eth010:38:401
6164991211,0cyclictest0-21swapper/111:30:561
6164991211,0cyclictest0-21swapper/111:30:561
6164991211,0cyclictest0-21swapper/111:24:401
6164991210,0cyclictest0-21swapper/111:14:121
616499120,0cyclictest30829-21sshd09:59:381
616499120,0cyclictest0-21swapper/112:02:531
616499120,0cyclictest0-21swapper/110:33:051
616499120,0cyclictest0-21swapper/110:01:081
6163991212,0cyclictest0-21swapper/010:27:210
6163991211,0cyclictest0-21swapper/011:51:410
6163991211,0cyclictest0-21swapper/010:34:190
6163991210,0cyclictest0-21swapper/012:26:390
6163991210,0cyclictest0-21swapper/011:01:160
6163991210,0cyclictest0-21swapper/010:36:110
616399120,0cyclictest0-21swapper/012:04:140
616399120,0cyclictest0-21swapper/010:45:280
616399120,0cyclictest0-21swapper/009:32:560
271120,0ktimersoftd/20-21swapper/211:36:592
271120,0ktimersoftd/20-21swapper/211:36:592
271120,0ktimersoftd/20-21swapper/208:55:172
117950120,0irq/26-eth1-rx-4446-21atenall_r7power10:00:172
110050120,0irq/25-eth00-21swapper/110:46:471
6166991111,0cyclictest0-21swapper/308:45:233
6166991110,0cyclictest20908-21ntp_kernel_pll_12:20:233
6166991110,0cyclictest16898-21munin-node07:30:153
6166991110,0cyclictest0-21swapper/310:50:173
6166991110,0cyclictest0-21swapper/309:13:443
6165991111,0cyclictest0-21swapper/212:24:502
6165991111,0cyclictest0-21swapper/210:06:432
6165991110,0cyclictest0-21swapper/211:29:332
6165991110,0cyclictest0-21swapper/210:44:422
6165991110,0cyclictest0-21swapper/210:30:322
616499119,0cyclictest0-21swapper/108:59:541
616499113,0cyclictest29067-21sshd12:14:171
6164991111,0cyclictest0-21swapper/111:05:151
6164991111,0cyclictest0-21swapper/107:25:221
616499110,0cyclictest0-21swapper/111:42:331
616499110,0cyclictest0-21swapper/108:32:171
616499110,0cyclictest0-21swapper/107:54:371
616499110,0cyclictest0-21swapper/107:40:491
616399119,0cyclictest0-21swapper/009:00:070
616399112,0cyclictest3-21ksoftirqd/011:20:010
6163991111,0cyclictest0-21swapper/012:22:140
6163991111,0cyclictest0-21swapper/012:15:370
6163991111,0cyclictest0-21swapper/012:09:550
6163991111,0cyclictest0-21swapper/011:56:410
6163991110,0cyclictest0-21swapper/009:49:570
616399110,0cyclictest0-21swapper/009:35:330
616399110,0cyclictest0-21swapper/008:16:260
41110,0ktimersoftd/00-21swapper/008:38:580
41110,0ktimersoftd/00-21swapper/008:05:370
191110,0ktimersoftd/10-21swapper/110:12:521
191110,0ktimersoftd/10-21swapper/108:20:401
191110,0ktimersoftd/10-21swapper/108:20:391
110050110,0irq/25-eth031323-21sshd10:56:183
110050110,0irq/25-eth017915-21sshd12:30:360
110050110,0irq/25-eth010276-21kworker/3:110:01:093
616699109,0cyclictest30781-21sshd10:42:053
616699109,0cyclictest0-21swapper/309:25:003
616699109,0cyclictest0-21swapper/309:20:153
6166991010,0cyclictest0-21swapper/312:12:523
6166991010,0cyclictest0-21swapper/310:10:403
616699100,0cyclictest1453-21nfsd11:26:253
616699100,0cyclictest0-21swapper/309:40:293
616599109,0cyclictest21559-21cp11:45:052
616599109,0cyclictest16206-21sshd12:12:512
616599109,0cyclictest0-21swapper/210:22:242
616599109,0cyclictest0-21swapper/209:22:002
6165991010,0cyclictest30185-21diskmemload11:21:462
6165991010,0cyclictest19330-21sshd11:41:102
6165991010,0cyclictest11710-21sshd09:36:032
6165991010,0cyclictest0-21swapper/212:38:402
6165991010,0cyclictest0-21swapper/212:32:232
6165991010,0cyclictest0-21swapper/208:05:202
616599100,0cyclictest13681-21sshd09:18:442
616599100,0cyclictest0-21swapper/208:46:202
616499109,0cyclictest24102-21sshd10:55:281
616499109,0cyclictest16511-21sshd09:25:591
616499109,0cyclictest0-21swapper/108:29:351
6164991010,0cyclictest0-21swapper/111:04:201
6164991010,0cyclictest0-21swapper/109:45:481
6164991010,0cyclictest0-21swapper/108:45:381
6164991010,0cyclictest0-21swapper/108:18:551
6164991010,0cyclictest0-21swapper/108:13:001
6164991010,0cyclictest0-21swapper/107:21:241
6164991010,0cyclictest0-21swapper/107:10:511
616499100,0cyclictest28134-21sshd09:34:251
616499100,0cyclictest0-21swapper/111:52:501
616499100,0cyclictest0-21swapper/108:35:121
616499100,0cyclictest0-21swapper/108:09:231
616499100,0cyclictest0-21swapper/107:49:311
616399109,0cyclictest3-21ksoftirqd/009:55:240
616399109,0cyclictest0-21swapper/007:46:420
616399106,0cyclictest3-21ksoftirqd/011:46:070
616399106,0cyclictest3-21ksoftirqd/009:21:460
6163991010,0cyclictest0-21swapper/011:29:430
6163991010,0cyclictest0-21swapper/007:24:370
6163991010,0cyclictest0-21swapper/007:16:580
616399100,0cyclictest0-21swapper/010:07:080
616399100,0cyclictest0-21swapper/008:25:170
616399100,0cyclictest0-21swapper/008:00:250
191100,0ktimersoftd/10-21swapper/109:52:401
1499100,0migration/024807-21bash12:10:170
110050100,0irq/25-eth09020-21sshd09:25:152
110050100,0irq/25-eth020-21ksoftirqd/111:18:291
110050100,0irq/25-eth011902-21sshd11:47:313
110050100,0irq/25-eth00-21swapper/112:27:161
110050100,0irq/25-eth00-21swapper/010:20:110
61669999,0cyclictest0-21swapper/312:29:153
61669998,0cyclictest0-21swapper/310:49:213
61669998,0cyclictest0-21swapper/309:56:033
61669990,0cyclictest0-21swapper/307:25:233
61659998,0cyclictest31064-21ls09:45:212
61659990,0cyclictest0-21swapper/209:13:302
61649999,0cyclictest0-21swapper/109:16:321
61649999,0cyclictest0-21swapper/109:07:201
61649999,0cyclictest0-21swapper/107:34:461
61649998,0cyclictest2119-21sshd11:28:441
61649990,0cyclictest30185-21diskmemload09:42:221
61639999,0cyclictest0-21swapper/008:53:160
61639999,0cyclictest0-21swapper/008:48:290
61639999,0cyclictest0-21swapper/007:41:340
61639995,0cyclictest0-21swapper/008:40:180
61639992,0cyclictest0-21swapper/009:10:180
61639990,0cyclictest0-21swapper/007:55:240
4190,0ktimersoftd/030185-21diskmemload11:06:520
4190,0ktimersoftd/026088-21sshd10:02:360
4190,0ktimersoftd/00-21swapper/011:30:560
4190,0ktimersoftd/00-21swapper/011:30:560
4190,0ktimersoftd/00-21swapper/008:12:030
11005090,0irq/25-eth027761-21sshd11:35:040
11005090,0irq/25-eth027761-21sshd11:35:040
11005090,0irq/25-eth01620-21runrttasks09:50:560
11005090,0irq/25-eth015914-21bash11:01:422
11005090,0irq/25-eth00-21swapper/112:18:431
61669987,0cyclictest7173-21sshd09:46:163
61669987,0cyclictest0-21swapper/312:06:333
61669980,0cyclictest0-21swapper/308:55:163
61669980,0cyclictest0-21swapper/307:15:013
61659988,0cyclictest0-21swapper/211:15:362
61659988,0cyclictest0-21swapper/208:14:092
61659988,0cyclictest0-21swapper/207:40:552
61659980,0cyclictest0-21swapper/208:24:232
61659980,0cyclictest0-21swapper/208:24:222
61659980,0cyclictest0-21swapper/208:00:182
61649988,0cyclictest0-21swapper/107:59:451
61649983,0cyclictest0-21swapper/109:01:311
61639988,0cyclictest0-21swapper/007:34:020
61639987,0cyclictest0-21swapper/007:50:170
61639982,0cyclictest0-21swapper/010:50:210
4180,0ktimersoftd/00-21swapper/007:10:000
159980,0watchdog/029232-21nfsd409:05:230
149980,0migration/015461-21sshd11:15:520
11005080,0irq/25-eth03399migration/310:15:483
11005080,0irq/25-eth021244-21df10:55:172
11005080,0irq/25-eth015485-21sshd10:05:033
11005080,0irq/25-eth012811-21sshd12:15:562
61669970,0cyclictest0-21swapper/308:00:203
61669970,0cyclictest0-21swapper/307:55:183
61659977,0cyclictest0-21swapper/207:28:572
61659974,0cyclictest5819-21sshd10:35:452
61659973,0cyclictest0-21swapper/210:50:212
61649976,0cyclictest20-21ksoftirqd/110:25:141
61649976,0cyclictest0-21swapper/110:50:231
61649971,0cyclictest0-21swapper/108:51:211
61649970,0cyclictest0-21swapper/108:00:271
61639977,0cyclictest0-21swapper/008:33:020
61639977,0cyclictest0-21swapper/008:22:220
61639977,0cyclictest0-21swapper/008:22:210
339970,0migration/312911-21nfsd408:30:183
11005070,0irq/25-eth025166-21sshd09:30:273
11005070,0irq/25-eth021666-21sshd11:05:513
61669965,0cyclictest5491-21fw_forwarded_lo08:15:153
61669965,0cyclictest14821-21conntrack08:35:143
61669962,0cyclictest0-21swapper/309:05:213
61669962,0cyclictest0-21swapper/309:00:173
61669962,0cyclictest0-21swapper/308:50:163
61669962,0cyclictest0-21swapper/308:40:173
61669962,0cyclictest0-21swapper/308:20:213
61669962,0cyclictest0-21swapper/308:20:203
61669962,0cyclictest0-21swapper/308:05:153
61669962,0cyclictest0-21swapper/307:45:173
61669962,0cyclictest0-21swapper/307:40:153
61669962,0cyclictest0-21swapper/307:35:173
61669962,0cyclictest0-21swapper/307:20:173
61669960,0cyclictest0-21swapper/308:10:113
61659965,0cyclictest28516-21diskstats09:05:182
61659965,0cyclictest23225-21cut07:45:112
61659965,0cyclictest17262-21munin-node08:40:162
61659962,0cyclictest0-21swapper/209:00:162
61659962,0cyclictest0-21swapper/208:50:152
61659962,0cyclictest0-21swapper/208:30:172
61659962,0cyclictest0-21swapper/208:25:172
61659962,0cyclictest0-21swapper/208:15:162
61659962,0cyclictest0-21swapper/207:50:162
61659962,0cyclictest0-21swapper/207:35:182
61659962,0cyclictest0-21swapper/207:15:002
61649962,0cyclictest0-21swapper/108:40:161
61649962,0cyclictest0-21swapper/107:15:191
61639962,0cyclictest0-21swapper/007:35:170
149960,0migration/015125-21pmu-power07:25:210
11795060,0irq/26-eth1-rx-0-21swapper/107:35:001
61669951,0cyclictest0-21swapper/307:10:173
61669950,0cyclictest0-21swapper/308:25:173
61669950,0cyclictest0-21swapper/307:50:143
61659953,0cyclictest0-21swapper/207:10:152
61659950,0cyclictest0-21swapper/207:55:182
61659950,0cyclictest0-21swapper/207:34:372
61659950,0cyclictest0-21swapper/207:20:072
249950,0watchdog/20-21swapper/208:35:102
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional