You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-09 - 16:25

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #a, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackaslot0.osadl.org (updated Wed Dec 07, 2022 12:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
61162830,0sleep30-21swapper/310:20:273
5172820,0sleep00-21swapper/011:46:200
319602660,1sleep20-21swapper/211:10:132
601026428,18sleep30-21swapper/307:07:123
307702640,0sleep20-21swapper/212:39:142
128992620,1sleep312894-21bash12:09:433
300582590,1sleep20-21swapper/210:36:312
290712590,1sleep30-21swapper/309:43:163
263682590,0sleep30-21swapper/310:44:413
156742590,0sleep30-21swapper/312:12:433
309072560,1sleep337-21rcuc/310:00:153
235932560,1sleep223591-21sshd10:16:202
160192560,1sleep316016-21bash09:56:063
274102550,2sleep10-21swapper/110:41:551
218462550,0sleep021847-21id09:59:280
194362550,0sleep00-21swapper/009:42:250
271742540,1sleep10-21swapper/111:15:211
258902540,1sleep20-21swapper/209:20:322
159092540,0sleep015908-21sshd09:36:280
69602530,1sleep30-21swapper/311:44:113
289682520,0sleep20-21swapper/212:25:082
18082520,1sleep21807-21sshd09:43:432
178302520,0sleep317818-21sshd11:22:513
159172520,1sleep21632-21sshd11:36:332
99882510,0sleep01546-21nfsd11:08:190
608525126,8sleep00-21swapper/007:08:010
614025027,19sleep10-21swapper/107:08:421
597225028,18sleep20-21swapper/207:06:432
37092500,0sleep30-21swapper/309:38:163
200682500,1sleep10-21swapper/110:21:401
130322500,0sleep20-21swapper/209:25:092
130322500,0sleep20-21swapper/209:25:092
115672500,1sleep011539-21sshd10:29:240
142162490,0sleep20-21swapper/209:53:132
97872480,0sleep30-21swapper/310:26:223
102282480,0sleep10-21swapper/109:50:071
199612460,0sleep00-21swapper/011:03:380
309222450,1sleep131607-21diskmemload12:36:251
111322440,1sleep3650699cyclictest12:37:303
222032430,0sleep10-21swapper/110:55:261
216082430,0sleep221607-21id11:00:542
107532430,0sleep10-21swapper/111:41:391
104822430,0sleep00-21swapper/010:57:130
253092380,0sleep225311-21id12:21:582
123102270,1sleep112288-21sshd09:33:251
184772230,2sleep10-21swapper/111:31:111
113782230,17sleep3120050irq/25-eth012:17:563
6506992219,2cyclictest0-21swapper/309:19:063
6499992220,1cyclictest22739-21sshd12:02:100
6506992119,1cyclictest0-21swapper/311:01:253
6505992119,1cyclictest28524-21sshd09:34:512
6502992119,1cyclictest13284-21sshd11:08:361
250842210,0sleep30-21swapper/312:24:493
6506992018,1cyclictest0-21swapper/309:50:243
6505991917,1cyclictest0-21swapper/212:32:222
650299190,1cyclictest26638-21sshd10:19:281
6499991917,1cyclictest6496-21sshd12:06:180
258292190,1sleep025827-21id12:38:480
165332190,2sleep016526-21sshd09:30:550
6502991816,1cyclictest30670-21sshd12:08:261
649999188,6cyclictest9209-21sshd11:10:560
44822180,1sleep28-21rcu_preempt11:30:042
650699172,10cyclictest39-21ksoftirqd/310:10:403
649999179,4cyclictest0-21swapper/010:35:200
45272170,1sleep14526-21bash10:51:041
297902170,1sleep029764-21sshd11:15:310
17812170,1sleep31756-21sshd09:26:543
17812170,1sleep31756-21sshd09:26:543
116712170,1sleep111647-21sshd12:23:391
6505991615,1cyclictest0-21swapper/210:01:112
6502991614,1cyclictest2256-21bash11:57:391
6502991613,2cyclictest19835-21sshd10:02:021
649999160,13cyclictest28735-21sshd09:46:020
649999160,12cyclictest25468-21sshd12:19:100
63222160,0sleep31787-21runrttasks11:32:573
31962160,1sleep30-21swapper/311:18:503
95942150,0sleep30-21swapper/307:15:163
6506991513,1cyclictest0-21swapper/312:27:093
650699150,12cyclictest0-21swapper/310:17:263
6505991512,2cyclictest0-21swapper/212:10:222
6502991513,1cyclictest10715-21sshd10:46:021
650299150,14cyclictest0-21swapper/111:45:041
649999159,5cyclictest0-21swapper/010:48:290
649999159,3cyclictest0-21swapper/011:25:020
649999159,3cyclictest0-21swapper/010:05:110
6499991511,3cyclictest6945-21sshd10:34:360
649999150,12cyclictest0-21swapper/012:10:490
649999150,12cyclictest0-21swapper/011:39:450
649999150,12cyclictest0-21swapper/010:24:160
649999150,11cyclictest27056-21kworker/0:112:20:390
276332150,1sleep30-21swapper/311:07:003
172562150,2sleep20-21swapper/210:21:252
16722150,0sleep21546-21nfsd09:57:422
650699149,4cyclictest0-21swapper/311:45:573
650699149,1cyclictest0-21swapper/310:54:363
650699140,13cyclictest0-21swapper/310:31:203
650699140,13cyclictest0-21swapper/309:12:283
650699140,13cyclictest0-21swapper/309:12:283
650699140,11cyclictest0-21swapper/312:01:003
650599149,2cyclictest0-21swapper/210:49:042
650599141,12cyclictest0-21swapper/211:06:102
650599141,12cyclictest0-21swapper/210:55:442
650599140,13cyclictest2173-21sshd11:18:462
650599140,11cyclictest28810-21users09:00:252
650599140,11cyclictest0-21swapper/210:13:232
6502991412,1cyclictest3827-21sshd09:10:201
6502991412,1cyclictest3827-21sshd09:10:201
6502991412,1cyclictest0-21swapper/110:09:381
650299141,1cyclictest120050irq/25-eth012:16:171
650299141,12cyclictest16353-21sshd11:14:271
6502991411,1cyclictest32223-21sshd10:36:431
650299140,1cyclictest127950irq/26-eth1-rx-11:21:051
650299140,13cyclictest30285-21bash12:00:051
649999149,3cyclictest0-21swapper/012:30:020
649999149,2cyclictest0-21swapper/009:28:050
649999149,2cyclictest0-21swapper/009:28:050
649999148,4cyclictest0-21swapper/012:25:230
649999148,3cyclictest22095-21sshd09:17:270
649999142,1cyclictest23940-21sshd11:31:390
649999141,2cyclictest0-21swapper/009:20:200
649999141,1cyclictest10150irq/24-ahci[00011:24:520
6499991410,1cyclictest0-21swapper/009:50:070
649999140,4cyclictest0-21swapper/011:58:190
649999140,3cyclictest0-21swapper/009:14:100
649999140,3cyclictest0-21swapper/009:14:100
649999140,1cyclictest0-21swapper/010:51:560
649999140,11cyclictest0-21swapper/011:51:560
649999140,11cyclictest0-21swapper/011:51:560
236592140,1sleep223651-21memory10:30:222
187332140,1sleep11787-21runrttasks10:32:451
151292140,1sleep10-21swapper/111:53:131
151292140,1sleep10-21swapper/111:53:131
650699131,3cyclictest37-21rcuc/311:39:063
6506991312,1cyclictest39-21ksoftirqd/310:55:113
6506991312,1cyclictest39-21ksoftirqd/310:05:343
6506991312,1cyclictest0-21swapper/310:37:513
6506991311,1cyclictest39-21ksoftirqd/311:29:293
6506991311,1cyclictest39-21ksoftirqd/310:45:383
6506991311,1cyclictest0-21swapper/311:53:353
6506991311,1cyclictest0-21swapper/311:53:353
650699130,2cyclictest5610-21sshd09:46:523
650699130,12cyclictest978-21sshd12:31:023
650699130,12cyclictest5569-21bash09:21:383
650599139,3cyclictest0-21swapper/210:44:472
650599139,3cyclictest0-21swapper/210:26:002
650599138,4cyclictest6576-21sshd11:27:252
6505991311,1cyclictest1632-21sshd09:36:452
650599131,11cyclictest0-21swapper/209:48:242
650599131,11cyclictest0-21swapper/209:15:202
650599130,2cyclictest15046-21sshd12:04:202
650599130,1cyclictest0-21swapper/211:48:232
650599130,12cyclictest0-21swapper/212:05:292
650599130,12cyclictest0-21swapper/211:51:182
650599130,12cyclictest0-21swapper/211:51:182
650599130,12cyclictest0-21swapper/211:22:302
650299131,9cyclictest6945-21sshd10:26:071
650299131,1cyclictest120050irq/25-eth009:35:341
6502991311,1cyclictest30471-21rm09:29:261
6502991311,1cyclictest30471-21rm09:29:261
6502991311,1cyclictest120050irq/25-eth012:13:431
650299130,2cyclictest8802-21sshd09:16:181
650299130,2cyclictest0-21swapper/112:27:061
650299130,2cyclictest0-21swapper/111:27:501
650299130,12cyclictest2544-21bash09:55:021
650299130,12cyclictest18975-21sshd09:20:021
650299130,12cyclictest12189-21sshd12:32:021
650299130,12cyclictest0-21swapper/109:49:201
650299130,10cyclictest0-21swapper/111:00:241
650299130,10cyclictest0-21swapper/109:44:191
649999138,3cyclictest29216-21sshd10:00:060
649999131,1cyclictest0-21swapper/011:40:300
649999131,11cyclictest16187-21sshd10:15:400
6499991310,1cyclictest120050irq/25-eth010:40:410
649999130,12cyclictest0-21swapper/010:11:550
200472130,5sleep339-21ksoftirqd/309:31:143
650699121,10cyclictest0-21swapper/311:55:183
650699121,10cyclictest0-21swapper/311:10:063
650699120,11cyclictest0-21swapper/308:20:223
650599129,2cyclictest0-21swapper/210:50:382
650599129,2cyclictest0-21swapper/210:05:152
650599121,10cyclictest0-21swapper/211:55:432
650599121,10cyclictest0-21swapper/209:10:132
650599121,10cyclictest0-21swapper/209:10:132
6505991210,1cyclictest30444-21sshd12:19:362
6505991210,1cyclictest1264-21sshd11:43:422
650599120,8cyclictest0-21swapper/207:25:142
650299129,2cyclictest0-21swapper/107:15:021
650299127,2cyclictest14786-21bash10:12:481
650299121,10cyclictest0-21swapper/111:35:151
649999121,10cyclictest0-21swapper/007:15:010
649999120,11cyclictest0-21swapper/008:45:490
650699110,11cyclictest0-21swapper/308:40:203
650599110,11cyclictest0-21swapper/208:40:162
650599110,11cyclictest0-21swapper/208:37:362
650599110,11cyclictest0-21swapper/208:34:072
650599110,11cyclictest0-21swapper/207:43:002
650599110,11cyclictest0-21swapper/207:14:472
650599110,10cyclictest9005-21diskstats07:15:012
650299119,1cyclictest0-21swapper/109:10:011
650299119,1cyclictest0-21swapper/109:10:011
649999113,4cyclictest0-21swapper/009:05:270
649999113,4cyclictest0-21swapper/009:05:270
649999110,11cyclictest0-21swapper/008:52:330
649999110,11cyclictest0-21swapper/008:30:500
649999110,11cyclictest0-21swapper/007:42:080
649999110,10cyclictest0-21swapper/009:03:410
649999110,10cyclictest0-21swapper/007:30:160
650599109,1cyclictest0-21swapper/208:56:402
650599109,1cyclictest0-21swapper/208:49:062
650599109,1cyclictest0-21swapper/208:27:572
650599109,1cyclictest0-21swapper/208:02:242
650599109,1cyclictest0-21swapper/207:47:462
650599107,2cyclictest0-21swapper/207:55:122
650599100,9cyclictest0-21swapper/209:10:012
650599100,9cyclictest0-21swapper/209:10:012
650599100,1cyclictest23016-21fschecks_time08:50:172
650599100,10cyclictest0-21swapper/208:07:452
650299100,1cyclictest1694-21perl08:05:191
650299100,1cyclictest0-21swapper/107:28:501
650299100,10cyclictest0-21swapper/108:47:231
650299100,10cyclictest0-21swapper/108:19:081
650299100,10cyclictest0-21swapper/107:13:521
649999109,1cyclictest0-21swapper/008:40:280
649999109,1cyclictest0-21swapper/008:37:480
649999109,1cyclictest0-21swapper/007:46:540
649999109,1cyclictest0-21swapper/007:36:200
649999105,5cyclictest0-21swapper/008:55:220
649999100,10cyclictest0-21swapper/007:13:480
65069998,1cyclictest0-21swapper/308:46:093
65069998,1cyclictest0-21swapper/307:22:583
65059998,1cyclictest0-21swapper/208:19:152
65059998,1cyclictest0-21swapper/208:11:142
65059998,1cyclictest0-21swapper/207:33:162
65059992,5cyclictest0-21swapper/207:50:252
65029997,2cyclictest0-21swapper/108:29:221
65029991,7cyclictest0-21swapper/108:55:151
65029991,7cyclictest0-21swapper/108:00:241
65029991,7cyclictest0-21swapper/107:42:201
65029991,7cyclictest0-21swapper/107:30:191
65029990,8cyclictest0-21swapper/107:46:011
65029990,6cyclictest0-21swapper/107:23:311
64999998,1cyclictest0-21swapper/008:11:260
64999998,1cyclictest0-21swapper/007:24:500
64999995,1cyclictest0-21swapper/008:15:120
64999991,7cyclictest0-21swapper/007:50:220
64999991,5cyclictest0-21swapper/008:20:290
64999990,6cyclictest0-21swapper/008:25:270
64999990,5cyclictest669-21perf08:05:000
64999990,5cyclictest0-21swapper/007:55:180
64999990,2cyclictest0-21swapper/008:05:260
65069985,3cyclictest0-21swapper/307:30:193
65069983,3cyclictest0-21swapper/308:27:163
65069981,6cyclictest0-21swapper/309:00:243
65069981,6cyclictest0-21swapper/308:50:193
65069981,6cyclictest0-21swapper/308:30:123
65069981,6cyclictest0-21swapper/308:00:243
65069980,7cyclictest0-21swapper/309:05:313
65069980,7cyclictest0-21swapper/309:05:303
65059987,1cyclictest0-21swapper/208:24:352
65059981,6cyclictest0-21swapper/207:20:192
65029987,1cyclictest0-21swapper/108:39:431
65029981,6cyclictest0-21swapper/108:20:301
65029981,6cyclictest0-21swapper/108:10:221
65029981,6cyclictest0-21swapper/107:55:171
64999987,1cyclictest0-21swapper/007:29:420
65069971,5cyclictest0-21swapper/308:10:123
65069971,5cyclictest0-21swapper/307:45:153
65069970,6cyclictest0-21swapper/308:55:163
65069970,6cyclictest0-21swapper/308:35:153
65069970,6cyclictest0-21swapper/308:05:213
65069970,6cyclictest0-21swapper/307:55:153
65069970,6cyclictest0-21swapper/307:40:163
65069970,6cyclictest0-21swapper/307:35:173
65069970,6cyclictest0-21swapper/307:25:173
65069970,6cyclictest0-21swapper/307:10:253
65069970,2cyclictest0-21swapper/307:51:283
65059970,6cyclictest0-21swapper/207:35:172
65029976,1cyclictest0-21swapper/108:31:141
65029976,1cyclictest0-21swapper/107:50:061
65029975,1cyclictest23223-21munin-node08:50:201
65029971,3cyclictest0-21swapper/109:00:131
65029970,6cyclictest0-21swapper/108:40:121
65069960,5cyclictest0-21swapper/308:15:143
65029960,2cyclictest0-21swapper/107:35:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional