You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-09 - 00:40

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #8, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack8slot0.osadl.org (updated Mon Aug 08, 2022 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2150521410,0sleep3952-21sshd11:24:523
2096321080,0sleep30-21swapper/312:26:493
746921030,0sleep30-21swapper/310:07:363
82502830,0sleep0141rcuc/011:00:400
71242800,0sleep20-21swapper/211:35:292
314142760,0sleep131378-21cp11:40:451
157552740,0sleep115756-21sshd11:51:241
207702730,1sleep220769-21grepconf.sh09:44:142
293752720,1sleep029376-21grepconf.sh10:40:280
200582720,1sleep320059-21sshd11:57:113
188852720,0sleep00-21swapper/012:00:000
10602720,1sleep11061-21grepconf.sh12:04:461
194482710,1sleep119413-21sshd12:12:361
292302700,0sleep3421rcuc/311:09:573
186782700,1sleep318677-21grep09:41:233
77702690,1sleep07736-21sshd10:14:350
77702690,1sleep07736-21sshd10:14:350
320982690,0sleep20-21swapper/210:23:552
131212690,0sleep00-21swapper/012:19:280
22652680,0sleep00-21swapper/011:14:190
66752670,0sleep00-21swapper/010:25:370
256432670,0sleep3421rcuc/312:14:183
14712670,1sleep01469-21grepconf.sh11:43:410
127272670,0sleep312729-21bash11:31:293
102552670,2sleep010217-21sshd11:17:240
116272660,0sleep00-21swapper/011:30:020
92522650,0sleep0141rcuc/011:06:210
82262650,1sleep18160-21sshd10:57:491
40042650,1sleep34005-21grep11:38:073
291882650,1sleep1241rcuc/110:26:341
234992650,0sleep3421rcuc/309:27:323
324332640,1sleep032389-21strings10:26:410
137992640,1sleep213792-21sshd12:12:212
325492630,1sleep1251ktimersoftd/110:54:401
283632620,0sleep228364-21grep10:58:422
27972620,0sleep30-21swapper/309:53:173
278122610,1sleep127798-21bash09:18:041
278122610,1sleep127798-21bash09:18:041
24432610,0sleep10-21swapper/110:18:281
167422610,0sleep10-21swapper/110:09:271
126912610,0sleep30-21swapper/311:14:463
157152600,0sleep015717-21grep10:20:280
281612590,0sleep10-21swapper/107:56:391
16022590,1sleep11571-21sshd12:30:161
271912580,0sleep30-21swapper/312:18:393
238422580,0sleep023837-21grepconf.sh10:48:380
15722560,0sleep30-21swapper/310:24:003
134822560,1sleep013481-21bash11:38:320
162372550,0sleep20-21swapper/211:37:142
315502540,1sleep131552-21grepconf.sh09:29:181
2923025225,9sleep30-21swapper/306:58:373
2933825125,8sleep10-21swapper/106:59:591
2914625125,8sleep00-21swapper/006:57:340
302672500,1sleep230266-21grep11:07:112
104492470,0sleep00-21swapper/009:45:130
2917524228,8sleep20-21swapper/206:57:562
149862280,0sleep20-21swapper/209:21:382
134022260,0sleep20-21swapper/209:29:552
120342240,0sleep1251ktimersoftd/111:11:551
323852230,0sleep3421rcuc/309:37:423
318962230,1sleep231899-21sshd10:53:132
29392230,1sleep12938-21bash11:18:291
91152220,0sleep30-21swapper/309:56:263
65352210,1sleep1241rcuc/109:04:291
29687992115,1cyclictest16002-21sshd10:06:362
280262210,1sleep028025-21bash10:04:170
134862210,1sleep213472-21sshd12:06:402
66112200,0sleep20-21swapper/210:11:442
66112200,0sleep20-21swapper/210:11:442
47362200,0sleep30-21swapper/311:00:313
314892200,1sleep131483-21sshd09:12:391
300522200,1sleep330044-21sshd12:23:003
270382200,1sleep127031-21sshd11:34:561
266012200,0sleep0141rcuc/011:34:550
223822200,1sleep022376-21sshd09:15:060
134102200,0sleep313388-21bash10:41:113
38012190,1sleep03800-21bash09:58:590
29687991914,3cyclictest879-21systemd-logind11:59:182
293932190,1sleep129392-21sshd09:09:461
280632190,1sleep2331rcuc/210:01:302
257602190,1sleep025683-21sshd09:50:060
252602190,0sleep20-21swapper/211:54:372
195962190,0sleep00-21swapper/009:07:530
143172190,0sleep00-21swapper/011:24:330
52732180,0sleep20-21swapper/210:50:402
37872180,1sleep13772-21sshd10:35:121
2967199186,11cyclictest19002-21kworker/0:309:22:120
29671991815,1cyclictest5857-21sshd12:26:140
29671991814,3cyclictest31082-21kworker/0:409:56:120
289362180,0sleep20-21swapper/212:24:232
271222180,0sleep30-21swapper/311:27:533
8472170,1sleep3821-21sshd09:09:563
692-21170,0sshd0-21swapper/310:51:493
63332170,2sleep32969199cyclictest10:49:173
50752170,0sleep30-21swapper/309:14:213
312312170,0sleep30-21swapper/312:04:403
29687991715,1cyclictest3807-21sshd09:19:492
29687991715,1cyclictest3807-21sshd09:19:492
29671991715,1cyclictest25295-21sshd09:40:150
29671991714,2cyclictest32171-21sshd12:23:060
27972170,0sleep12795-21bash11:42:181
242982170,0sleep20-21swapper/209:55:412
201722170,1sleep3854-21rngd09:03:393
72682160,0sleep27209-21sshd09:07:192
35412160,0sleep20-21swapper/209:57:332
29691991614,1cyclictest17119-21grepconf.sh09:49:433
29681991613,2cyclictest879-21systemd-logind09:43:281
29681991613,1cyclictest29334-21sshd10:40:281
2968199160,15cyclictest12660-21sshd11:21:401
29671991613,2cyclictest6451-21kworker/0:211:53:540
29671991613,1cyclictest5234-21sshd10:08:560
29671991611,1cyclictest9-21ksoftirqd/012:09:540
227292160,0sleep10-21swapper/112:17:011
202262160,0sleep00-21swapper/010:44:170
154162160,0sleep20-21swapper/209:36:572
147482160,1sleep00-21swapper/011:03:450
29691991513,1cyclictest44-21ksoftirqd/311:56:143
29691991512,1cyclictest879-21systemd-logind10:28:193
29687991513,1cyclictest24579-21grepconf.sh09:02:252
29687991513,1cyclictest16621-21sshd10:37:052
29687991512,2cyclictest3594-21sshd09:12:522
29687991511,2cyclictest6468-21sshd10:28:202
2968799150,1cyclictest92050irq/26-p4p1-rx-12:04:542
29681991513,1cyclictest946-21sshd12:24:351
29681991513,1cyclictest1-21systemd09:38:291
29681991512,2cyclictest26587-21sshd12:00:201
29681991512,1cyclictest9876-21sshd10:16:051
29681991512,1cyclictest9876-21sshd10:16:051
29681991512,1cyclictest606-21systemd-journal09:52:421
2968199150,13cyclictest15886-21sshd10:21:471
29671991513,0cyclictest29401-21bash10:54:320
29671991512,1cyclictest9-21ksoftirqd/012:14:590
29671991512,1cyclictest9-21ksoftirqd/010:35:100
29691991412,1cyclictest6804-21sshd12:06:263
29691991412,1cyclictest5344-21sshd11:01:543
29691991412,1cyclictest44-21ksoftirqd/310:17:403
29691991412,1cyclictest17671-21sshd11:42:573
29691991412,1cyclictest16956-21sshd10:34:223
29691991412,1cyclictest14730-21sshd11:17:363
29691991412,1cyclictest14616-21sshd09:32:453
29691991412,1cyclictest14434-21grepconf.sh09:21:373
29691991412,1cyclictest13465-21grepconf.sh11:46:593
2969199141,1cyclictest121rcu_sched10:42:423
29691991411,0cyclictest91950irq/25-em108:30:273
2969199140,1cyclictest121rcu_sched09:19:503
2969199140,1cyclictest121rcu_sched09:19:503
2969199140,13cyclictest0-21swapper/308:21:363
29687991412,1cyclictest606-21systemd-journal11:49:142
29687991412,1cyclictest2053-21sshd10:17:032
29687991412,1cyclictest16975-21sshd10:42:422
29687991412,1cyclictest13465-21sshd09:31:212
29687991411,2cyclictest92050irq/26-p4p1-rx-12:16:432
29687991411,2cyclictest879-21systemd-logind11:12:472
29687991411,2cyclictest18714-21unixbench_multi12:26:432
2968799140,13cyclictest14295-21sshd11:21:432
2968799140,13cyclictest0-21swapper/208:21:352
2968199143,10cyclictest29479-21sshd09:58:421
29681991412,1cyclictest27935-21sshd09:23:351
29681991412,1cyclictest25995-21sshd11:27:501
2968199141,1cyclictest1845-21nfsd11:46:321
2968199140,1cyclictest0-21swapper/111:03:271
2968199140,13cyclictest0-21swapper/108:21:291
29671991412,1cyclictest8587-21sshd11:46:460
29671991412,1cyclictest32183-21grepconf.sh09:19:380
29671991412,1cyclictest32183-21grepconf.sh09:19:380
29671991412,1cyclictest29492-21sshd12:01:480
29691991311,1cyclictest10366-21sshd10:03:303
29691991310,1cyclictest44-21ksoftirqd/310:11:353
29691991310,1cyclictest44-21ksoftirqd/310:11:353
29687991311,1cyclictest879-21systemd-logind09:48:312
29687991311,1cyclictest7029-21sshd11:01:592
29687991311,1cyclictest18670-21sshd11:19:102
29687991311,1cyclictest16309-21grepconf.sh10:35:452
2968199138,4cyclictest26-21ksoftirqd/110:49:281
29681991311,1cyclictest26921-21sshd09:50:091
29681991311,1cyclictest26712-21sshd12:10:071
29681991311,1cyclictest26593-21sshd11:08:271
29681991310,2cyclictest1-21systemd09:32:021
29681991310,2cyclictest11700-21sshd10:05:001
29671991311,1cyclictest9-21ksoftirqd/009:33:410
29671991311,1cyclictest9-21ksoftirqd/009:27:430
29671991311,1cyclictest9-21ksoftirqd/009:04:100
2969199129,1cyclictest44-21ksoftirqd/309:01:143
2968799128,3cyclictest2035-21sshd11:29:372
2968799120,1cyclictest13503-21grepconf.sh11:44:132
2968199129,1cyclictest0-21swapper/107:06:151
2968199120,11cyclictest0-21swapper/110:42:511
2967199127,3cyclictest32248-21kworker/0:108:27:080
2969199119,1cyclictest0-21swapper/308:51:293
2969199110,9cyclictest0-21swapper/308:46:283
2969199110,9cyclictest0-21swapper/307:06:143
2969199110,2cyclictest13422-21fw_conntrack08:31:313
2969199110,1cyclictest0-21swapper/308:06:333
2969199110,1cyclictest0-21swapper/307:46:293
2969199110,1cyclictest0-21swapper/307:36:393
2968799118,1cyclictest0-21swapper/208:46:332
2968799110,9cyclictest0-21swapper/208:51:302
2968799110,1cyclictest0-21swapper/208:56:312
2968799110,1cyclictest0-21swapper/208:36:312
2968799110,1cyclictest0-21swapper/208:31:362
2968799110,1cyclictest0-21swapper/208:26:322
2968799110,1cyclictest0-21swapper/208:06:272
2968799110,1cyclictest0-21swapper/207:51:302
2968799110,10cyclictest6423-21df_inode07:16:272
2968799110,10cyclictest19729-21perl07:41:312
2968799110,10cyclictest18616-21fw_forwarded_lo08:41:292
2968799110,10cyclictest0-21swapper/208:02:112
2968199119,1cyclictest29867-21diskstats08:01:311
2968199119,1cyclictest0-21swapper/108:16:261
2968199119,1cyclictest0-21swapper/107:11:391
2968199118,1cyclictest0-21swapper/108:46:321
2968199110,9cyclictest13997-21nfsd408:31:351
2968199110,1cyclictest4808-21latency_hist08:16:131
2968199110,10cyclictest32702-21perl08:06:281
2968199110,10cyclictest0-21swapper/108:41:501
2967199118,2cyclictest2178-21cat08:11:130
2967199110,9cyclictest0-21swapper/008:51:290
2967199110,2cyclictest18271-21diskstats08:41:280
2967199110,1cyclictest3625-21nfsd408:11:320
2967199110,1cyclictest32538-21grep07:06:140
2967199110,1cyclictest0-21swapper/008:56:310
2967199110,1cyclictest0-21swapper/008:46:280
2967199110,1cyclictest0-21swapper/008:36:310
2967199110,10cyclictest5633-21fw_conntrack08:16:290
2967199110,10cyclictest14217-21diskstats07:31:300
2969199108,1cyclictest30312-21hddtemp_smartct08:01:333
2969199108,1cyclictest25509-21grep07:51:363
2969199108,1cyclictest20353-21awk07:41:393
2969199108,1cyclictest0-21swapper/308:41:283
2969199108,1cyclictest0-21swapper/307:56:383
2969199108,1cyclictest0-21swapper/307:26:353
2969199100,9cyclictest0-21swapper/308:36:313
2969199100,9cyclictest0-21swapper/308:16:293
2969199100,9cyclictest0-21swapper/307:18:113
2968799108,1cyclictest6213-21awk08:16:332
2968799100,9cyclictest30538-21fw_forwarded_lo07:01:362
2968799100,9cyclictest22451-21sh07:46:302
2968799100,9cyclictest0-21swapper/207:11:592
2968799100,9cyclictest0-21swapper/207:06:142
2968799100,1cyclictest0-21swapper/208:11:272
2968199109,0cyclictest0-21swapper/107:21:331
2968199108,1cyclictest0-21swapper/107:26:341
2968199100,9cyclictest0-21swapper/108:56:311
2968199100,9cyclictest0-21swapper/108:51:311
2968199100,9cyclictest0-21swapper/108:36:311
2968199100,9cyclictest0-21swapper/108:26:311
2968199100,1cyclictest6629-21perl07:16:281
2968199100,1cyclictest24156-21/usr/sbin/munin07:51:401
2968199100,0cyclictest0-21swapper/107:43:091
2967199109,0cyclictest0-21swapper/007:46:270
2967199108,1cyclictest0-21swapper/007:36:320
2967199107,3cyclictest32248-21kworker/0:108:01:320
2967199107,2cyclictest32248-21kworker/0:107:20:220
2967199107,2cyclictest32248-21kworker/0:107:11:140
2967199107,1cyclictest32248-21kworker/0:107:21:480
2967199105,2cyclictest32248-21kworker/0:107:51:180
2967199100,9cyclictest7887-21diskstats08:21:280
2967199100,9cyclictest0-21swapper/007:56:340
2967199100,1cyclictest13392-21cut08:31:310
2967199100,1cyclictest0-21swapper/007:41:310
296919998,0cyclictest0-21swapper/307:21:323
296919990,0cyclictest0-21swapper/308:11:313
296879998,0cyclictest0-21swapper/207:38:572
296879998,0cyclictest0-21swapper/207:32:262
296879997,1cyclictest28003-21date07:56:382
296879997,1cyclictest11968-21fw_conntrack07:26:352
296879990,8cyclictest0-21swapper/207:21:322
296819998,0cyclictest0-21swapper/107:46:301
296819998,0cyclictest0-21swapper/107:41:131
296819998,0cyclictest0-21swapper/107:03:251
296719997,1cyclictest0-21swapper/007:26:350
296719996,2cyclictest4797-21kworker/0:007:01:580
296919987,0cyclictest0-21swapper/307:15:523
296919970,5cyclictest0-21swapper/307:01:353
296919970,1cyclictest14891-21ls07:31:403
296819970,1cyclictest1882-21sendmail07:33:421
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional