You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-07-29 - 17:06

Intel(R) Xeon(R) CPU E3-1220L V2 @ 2.30GHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #8, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack8slot0.osadl.org (updated Thu Jul 29, 2021 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1462521580,3sleep3585199cyclictest10:44:133
2057121410,0sleep20-21swapper/209:29:202
1820921390,2sleep325162-21systemd09:03:123
3089921350,2sleep3585199cyclictest09:55:513
3089921350,2sleep3585199cyclictest09:55:513
916021080,0sleep30-21swapper/309:34:383
184821050,0sleep20-21swapper/212:15:512
77512920,2sleep125162-21systemd09:47:311
235332860,1sleep123523-21sshd12:13:531
269822810,2sleep0851-21avahi-daemon09:54:110
269822810,2sleep0851-21avahi-daemon09:54:110
209552780,1sleep325162-21systemd09:25:003
177342750,1sleep00-21swapper/011:06:020
232012740,1sleep223128-21sshd10:46:042
273962730,1sleep027397-21sshd09:03:370
255192730,1sleep3858-21dbus-daemon10:25:573
70252720,1sleep11-21systemd11:20:021
262362720,1sleep126234-21bash10:36:051
218642720,0sleep20-21swapper/210:54:382
237432710,1sleep10-21swapper/110:27:151
183772710,0sleep00-21swapper/011:50:390
11572710,0sleep00-21swapper/011:41:180
24782700,1sleep22469-21sshd12:04:162
128342700,0sleep012827-21sshd10:49:550
54682690,0sleep00-21swapper/011:32:480
294672690,1sleep029449-21sshd10:59:170
294492670,0sleep30-21swapper/312:24:173
261142670,0sleep00-21swapper/009:12:110
260362670,1sleep326035-21sshd11:35:113
195202670,2sleep0584899cyclictest11:07:310
168552670,1sleep016858-21grep11:23:180
156482670,1sleep115646-21sshd09:23:181
130382670,1sleep013036-21bash09:17:240
263932660,2sleep2585099cyclictest09:55:382
263932660,2sleep2585099cyclictest09:55:382
195722660,1sleep319570-21sshd09:45:133
119132660,0sleep1241rcuc/112:20:391
79902650,1sleep17989-21sshd11:31:291
279242650,0sleep10-21swapper/110:14:331
200402640,0sleep20-21swapper/207:26:252
171652640,0sleep30-21swapper/309:08:573
93662630,0sleep1251ktimersoftd/111:12:531
34092630,0sleep20-21swapper/211:47:052
323992630,0sleep20-21swapper/211:38:192
93202620,0sleep10-21swapper/111:04:111
302382620,1sleep2918-21gdbus11:25:202
101742620,1sleep310177-21grepconf.sh11:48:503
261592610,0sleep20-21swapper/211:19:272
159512610,0sleep30-21swapper/312:16:283
136662610,0sleep30-21swapper/308:16:413
181532600,0sleep20-21swapper/211:14:462
260512590,0sleep30-21swapper/311:56:403
546025426,8sleep00-21swapper/006:59:350
289232530,0sleep20-21swapper/211:06:282
539625225,8sleep10-21swapper/106:58:521
537825226,8sleep20-21swapper/206:58:412
60892440,0sleep20-21swapper/209:21:272
330524225,9sleep30-21swapper/306:56:183
18782390,1sleep31871-21sshd10:49:263
277272320,1sleep227726-21sshd10:17:222
282902310,1sleep228288-21sshd09:12:172
167952290,0sleep20-21swapper/209:58:062
73792280,1sleep07377-21grep11:57:170
308852280,0sleep30-21swapper/311:09:303
151982260,0sleep30-21swapper/310:34:073
296202250,0sleep10-21swapper/110:37:371
251842240,0sleep00-21swapper/010:53:200
129812240,0sleep20-21swapper/210:23:552
207432230,1sleep00-21swapper/010:28:340
162292220,0sleep10-21swapper/110:50:041
81672210,0sleep10-21swapper/110:10:521
5851992118,2cyclictest0-21swapper/309:37:083
5849992118,1cyclictest10310-21id12:08:571
5848992113,1cyclictest863-21systemd-logind10:17:390
173772210,0sleep30-21swapper/310:29:543
14592210,0sleep1241rcuc/109:12:321
12532210,0sleep30-21swapper/311:25:293
585099200,1cyclictest1385-21grep09:47:142
5848992013,1cyclictest1625-21packagekitd09:09:060
5848992012,1cyclictest1625-21packagekitd09:38:260
5848992010,2cyclictest1625-21packagekitd12:27:160
584899200,19cyclictest0-21swapper/012:11:150
584899200,12cyclictest25162-21systemd09:22:360
258472200,1sleep1858-21dbus-daemon09:02:061
250142200,0sleep325010-21sshd11:19:243
228692200,1sleep1241rcuc/109:51:081
228692200,1sleep1241rcuc/109:51:081
14572200,0sleep00-21swapper/012:20:090
5850991916,2cyclictest1625-21packagekitd09:35:392
5848991912,1cyclictest29759-21sshd09:42:440
5848991911,1cyclictest4214-21grep10:23:310
5848991911,1cyclictest20529-21sshd10:37:120
5848991911,1cyclictest1625-21packagekitd10:15:410
5848991910,1cyclictest858-21dbus-daemon12:08:090
5848991910,1cyclictest1625-21packagekitd09:48:060
584899190,13cyclictest0-21swapper/008:11:230
52992190,1sleep2863-21systemd-logind09:09:522
90292180,0sleep30-21swapper/311:37:163
585199180,17cyclictest0-21swapper/308:53:223
585099180,17cyclictest0-21swapper/208:23:552
585099180,17cyclictest0-21swapper/208:04:182
585099180,17cyclictest0-21swapper/207:57:292
585099180,16cyclictest0-21swapper/207:24:192
585099180,15cyclictest0-21swapper/211:45:292
585099180,0cyclictest0-21swapper/207:08:172
584999180,1cyclictest1-21systemd11:07:331
5848991815,2cyclictest1625-21packagekitd09:58:410
258522180,0sleep00-21swapper/009:28:060
258452180,1sleep00-21swapper/010:36:040
244692180,0sleep30-21swapper/309:13:343
10252180,0sleep30-21swapper/309:57:233
74652170,1sleep2331rcuc/209:04:112
585199170,16cyclictest0-21swapper/310:54:103
5850991713,2cyclictest1625-21packagekitd09:20:012
5849991715,1cyclictest916-21polkitd11:43:501
5849991715,1cyclictest12118-21grepconf.sh09:56:271
5849991713,2cyclictest1625-21packagekitd10:58:091
5849991713,1cyclictest26-21ksoftirqd/111:26:321
5849991710,1cyclictest25162-21systemd11:51:281
584999170,16cyclictest0-21swapper/110:25:001
584999170,16cyclictest0-21swapper/110:04:051
584999170,15cyclictest0-21swapper/108:26:181
584999170,0cyclictest0-21swapper/108:37:241
584999170,0cyclictest0-21swapper/108:37:241
5848991710,1cyclictest17024-21grep10:41:270
36292170,0sleep20-21swapper/211:28:252
263092170,4sleep344-21ksoftirqd/309:20:553
256332170,0sleep30-21swapper/310:08:453
110102170,1sleep110992-21bash12:26:201
5851991614,1cyclictest1625-21packagekitd12:08:183
5851991614,1cyclictest1432-21nfsd09:27:273
5851991613,2cyclictest25162-21systemd10:19:193
5851991612,2cyclictest1625-21packagekitd11:53:013
585199160,15cyclictest0-21swapper/311:03:363
585199160,15cyclictest0-21swapper/307:24:553
585199160,15cyclictest0-21swapper/307:06:373
585199160,14cyclictest0-21swapper/308:46:413
5850991614,1cyclictest27542-21sshd10:27:262
5850991613,2cyclictest863-21systemd-logind11:01:332
5850991612,3cyclictest941-21sshd10:39:512
5850991612,2cyclictest22158-21sshd09:36:372
5850991612,2cyclictest1625-21packagekitd11:55:512
585099160,15cyclictest0-21swapper/208:54:162
585099160,15cyclictest0-21swapper/208:35:092
585099160,15cyclictest0-21swapper/208:07:062
585099160,15cyclictest0-21swapper/207:16:312
584999164,9cyclictest26-21ksoftirqd/111:37:211
584999164,9cyclictest26-21ksoftirqd/109:32:201
584999162,11cyclictest121rcu_sched09:18:411
584999162,10cyclictest26-21ksoftirqd/109:26:101
5849991613,2cyclictest31895-21sshd11:48:221
5849991610,3cyclictest26-21ksoftirqd/112:22:071
584899160,15cyclictest0-21swapper/008:32:210
584899160,15cyclictest0-21swapper/007:46:110
584899160,12cyclictest0-21swapper/008:03:530
214142160,0sleep3421rcuc/311:14:553
585199152,1cyclictest13237-21sshd10:02:203
5851991513,1cyclictest20807-21sshd09:49:353
585199151,2cyclictest858-21dbus-daemon10:59:053
5851991512,2cyclictest1625-21packagekitd12:02:143
5851991512,1cyclictest28042-21sshd10:13:073
5851991512,1cyclictest1625-21packagekitd12:30:203
5851991512,1cyclictest1432-21nfsd12:11:523
585199150,14cyclictest0-21swapper/308:06:473
585199150,14cyclictest0-21swapper/307:48:443
585199150,14cyclictest0-21swapper/307:30:493
585199150,13cyclictest0-21swapper/308:33:243
5850991512,2cyclictest1625-21packagekitd10:05:132
5850991512,2cyclictest11675-21bash12:26:212
5850991512,1cyclictest863-21systemd-logind12:08:272
5850991511,2cyclictest1625-21packagekitd11:00:432
585099150,1cyclictest20472-21cp12:21:022
585099150,14cyclictest0-21swapper/208:48:182
585099150,14cyclictest0-21swapper/208:43:482
585099150,14cyclictest0-21swapper/208:40:062
585099150,14cyclictest0-21swapper/208:40:062
585099150,14cyclictest0-21swapper/207:35:402
585099150,13cyclictest28314-21bash10:50:372
585099150,13cyclictest0-21swapper/207:36:312
584999156,1cyclictest26-21ksoftirqd/110:16:071
5849991513,1cyclictest26-21ksoftirqd/109:06:221
5849991512,2cyclictest0-21swapper/107:10:101
5849991511,1cyclictest26-21ksoftirqd/109:36:191
584999150,14cyclictest0-21swapper/108:35:061
584999150,14cyclictest0-21swapper/107:01:311
584999150,13cyclictest0-21swapper/110:41:261
584999150,13cyclictest0-21swapper/108:18:271
584899155,9cyclictest5125-21id12:24:390
584899153,10cyclictest918-21gdbus11:53:380
5848991513,1cyclictest1625-21packagekitd11:38:350
5848991513,1cyclictest1625-21packagekitd10:01:140
5848991513,1cyclictest1432-21nfsd12:03:520
584899150,14cyclictest0-21swapper/008:20:180
5851991411,2cyclictest863-21systemd-logind11:43:133
585199141,12cyclictest0-21swapper/307:53:533
585199140,13cyclictest0-21swapper/311:26:493
585099149,3cyclictest0-21swapper/210:06:282
5850991412,1cyclictest863-21systemd-logind09:42:592
5850991412,1cyclictest28545-21grepconf.sh12:25:412
5850991412,1cyclictest1625-21packagekitd11:59:392
585099140,4cyclictest858-21dbus-daemon10:15:302
585099140,13cyclictest0-21swapper/208:19:572
585099140,13cyclictest0-21swapper/208:14:172
585099140,13cyclictest0-21swapper/207:47:592
584999145,4cyclictest6987-21sshd11:22:511
5849991412,1cyclictest11367-21sshd11:58:551
584999140,3cyclictest111rcu_preempt09:42:001
584999140,1cyclictest121rcu_sched12:03:411
584999140,13cyclictest0-21swapper/108:59:251
584999140,13cyclictest0-21swapper/108:23:121
584999140,13cyclictest0-21swapper/108:00:081
584999140,13cyclictest0-21swapper/107:29:371
584999140,12cyclictest0-21swapper/108:44:151
584999140,12cyclictest0-21swapper/107:39:531
584999140,12cyclictest0-21swapper/107:32:131
584999140,12cyclictest0-21swapper/107:13:581
5848991412,1cyclictest863-21systemd-logind11:11:130
5848991412,1cyclictest32230-21sshd11:26:470
584899140,12cyclictest0-21swapper/007:43:560
584899140,12cyclictest0-21swapper/007:43:560
584899140,12cyclictest0-21swapper/007:08:460
585199130,1cyclictest2243-21sshd10:37:513
585199130,12cyclictest0-21swapper/307:34:103
585099139,3cyclictest0-21swapper/210:31:412
585099130,12cyclictest0-21swapper/207:12:152
585099130,10cyclictest863-21systemd-logind11:31:302
584999138,1cyclictest121rcu_sched10:51:211
584999130,12cyclictest0-21swapper/108:08:441
5848991310,2cyclictest858-21dbus-daemon10:06:470
584899130,12cyclictest0-21swapper/008:56:580
584899130,12cyclictest0-21swapper/007:52:020
584899130,12cyclictest0-21swapper/007:37:100
584899130,12cyclictest0-21swapper/007:32:490
585199120,11cyclictest0-21swapper/308:04:593
584999120,11cyclictest0-21swapper/107:49:411
584999120,11cyclictest0-21swapper/107:16:251
584999120,10cyclictest0-21swapper/108:01:141
584899129,1cyclictest5699-21rs:main0
584899120,2cyclictest25162-21systemd09:32:180
584899120,11cyclictest0-21swapper/008:24:510
584899120,11cyclictest0-21swapper/007:17:310
584899120,10cyclictest0-21swapper/008:50:420
585199118,1cyclictest0-21swapper/308:21:233
585199110,9cyclictest0-21swapper/307:16:303
585199110,1cyclictest0-21swapper/308:26:243
585199110,10cyclictest24981-21tune2fs07:36:243
585199110,10cyclictest23403-21nfsd408:36:253
585199110,10cyclictest23403-21nfsd408:36:253
585199110,10cyclictest10371-21cat08:11:213
585199110,10cyclictest0-21swapper/307:57:563
585099111,9cyclictest0-21swapper/207:01:162
585099110,1cyclictest0-21swapper/208:26:292
584999119,1cyclictest0-21swapper/108:51:181
584999110,9cyclictest0-21swapper/108:46:391
584999110,9cyclictest0-21swapper/107:41:211
584999110,9cyclictest0-21swapper/107:41:211
584999110,10cyclictest0-21swapper/108:15:091
584999110,10cyclictest0-21swapper/107:54:381
584899110,10cyclictest7773-21perl08:06:210
584899110,10cyclictest31003-21nfsd408:51:240
584899110,10cyclictest0-21swapper/008:28:240
585199100,9cyclictest27941-21nfsd407:41:253
585199100,9cyclictest27941-21nfsd407:41:253
585199100,1cyclictest605-21fw_conntrack08:56:273
585099100,9cyclictest32605-21perl07:51:232
585099100,0cyclictest0-21swapper/207:41:192
585099100,0cyclictest0-21swapper/207:41:192
584899108,1cyclictest19688-21diskstats07:26:230
584899108,1cyclictest0-21swapper/007:21:230
584899100,9cyclictest22599-21diskstats08:36:190
584899100,9cyclictest22599-21diskstats08:36:190
584899100,1cyclictest26357-21ls08:41:310
584899100,1cyclictest0-21swapper/007:56:270
584899100,1cyclictest0-21swapper/007:11:290
584899100,0cyclictest0-21swapper/007:01:260
58519998,0cyclictest0-21swapper/308:41:193
58519990,8cyclictest0-21swapper/307:11:293
58509998,0cyclictest0-21swapper/208:56:272
58519980,7cyclictest0-21swapper/307:04:013
58499971,1cyclictest121rcu_sched07:21:371
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional