You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-05-12 - 13:14

Intel(R) Xeon(R) CPU E3-1220L V2 @ 2.30GHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #8, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack8slot0.osadl.org (updated Wed May 12, 2021 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1349121530,2sleep3547399cyclictest22:35:263
2325321380,0sleep1241rcuc/121:13:571
151021290,3sleep2331rcuc/223:58:242
3205021280,1sleep0545699cyclictest21:27:350
2532821200,0sleep30-21swapper/321:25:463
1632121180,3sleep3547399cyclictest00:20:023
275722860,2sleep327500-21cp21:12:393
128642860,0sleep1241rcuc/123:22:191
118002860,1sleep211740-21sshd21:13:262
320852850,1sleep21431-21nfsd21:40:442
79152840,3sleep3547399cyclictest21:55:413
45742840,0sleep20-21swapper/223:26:172
36692840,1sleep03643-21bash23:21:540
200922840,1sleep120031-21sshd21:40:111
185382830,2sleep118531-21sshd23:02:061
109982820,3sleep0545699cyclictest23:11:550
230402810,1sleep223024-21sshd23:49:142
43122800,1sleep01432-21nfsd21:49:400
233672800,1sleep023363-21sshd23:40:180
214812800,1sleep221470-21ntp_states22:09:232
200882800,1sleep220025-21sshd21:22:362
18992800,1sleep3421rcuc/300:07:193
164202800,1sleep016410-21sshd21:16:290
233992790,1sleep223398-21grep23:21:192
13662790,1sleep21325-21sshd21:06:562
190032780,1sleep019004-21grep23:45:590
174722780,2sleep3547399cyclictest22:07:473
46642770,1sleep24658-21grepconf.sh00:05:582
139092770,1sleep1546299cyclictest22:42:501
134172770,1sleep2546899cyclictest21:31:062
12822760,1sleep11-21systemd22:46:421
110632760,1sleep011001-21sshd23:34:000
45292750,1sleep34526-21grep21:07:053
247482750,1sleep124746-21systemd-cgroups23:57:591
125762750,1sleep11432-21nfsd23:51:371
97362730,0sleep10-21swapper/100:24:171
222082730,1sleep322209-21bash23:50:353
96712720,2sleep29670-21id22:14:442
288452720,2sleep128841-21grep22:37:361
215612720,1sleep121513-21cp22:27:021
43032700,0sleep10-21swapper/121:30:411
210042690,1sleep120851-21sshd22:09:221
133552690,0sleep2331rcuc/223:10:332
106372680,0sleep310639-21id22:58:473
75862670,1sleep17587-21sshd21:14:371
305762660,1sleep230574-21bash22:05:262
268312660,0sleep00-21swapper/023:02:290
239802660,2sleep123978-21bash22:30:031
180002660,1sleep317986-21sshd00:18:343
171652660,1sleep117143-21bash22:00:321
167882660,1sleep316782-21bash21:40:013
105092650,1sleep010462-21bash22:55:480
276452640,1sleep027646-21bash21:46:240
250942630,0sleep0141rcuc/000:00:550
166352630,0sleep20-21swapper/221:35:392
57112610,2sleep3547399cyclictest22:39:273
244142610,0sleep3421rcuc/323:37:283
212882610,1sleep021287-21sshd22:50:260
144882610,1sleep0916-21polkitd22:48:460
127082610,0sleep20-21swapper/221:26:412
163242570,0sleep0141rcuc/022:07:440
486625528,8sleep00-21swapper/018:59:440
258012550,1sleep228847-21kworker/2:223:44:492
66312490,1sleep36634-21bash21:35:123
488024429,9sleep20-21swapper/218:59:542
506624228,8sleep30-21swapper/319:02:073
496824227,8sleep10-21swapper/119:00:531
92162350,13sleep391350irq/26-p4p1-rx-23:55:483
47412320,1sleep04735-21bash21:43:590
251862290,0sleep2331rcuc/222:21:132
38942270,0sleep00-21swapper/022:24:400
127562270,1sleep112753-21sshd21:28:121
46112260,1sleep14612-21sshd21:23:231
32522260,1sleep33249-21bash22:20:143
187552260,2sleep218754-21systemd22:31:202
53452250,1sleep0858-21dbus-daemon23:26:190
229022250,1sleep322906-21sshd21:50:313
182962250,0sleep10-21swapper/100:02:081
294292240,0sleep229428-21grepconf.sh21:45:012
218192240,3sleep1961-21snmpd21:56:191
132092240,1sleep213181-21bash21:58:562
60012230,0sleep21432-21nfsd00:31:482
324482230,0sleep232434-21bash22:24:302
237442230,1sleep023742-21grepconf.sh00:23:280
187642230,2sleep118736-21bash21:44:321
105062230,1sleep010510-21bash22:11:490
5468992219,2cyclictest27160-21grepconf.sh22:40:262
316622220,0sleep31625-21packagekitd23:18:523
287802220,1sleep11-21systemd23:33:211
255502220,2sleep21-21systemd00:03:572
180932220,1sleep318097-21sshd23:41:333
118272220,1sleep311832-21bash22:31:013
5473992119,1cyclictest11658-21bash00:13:423
5456992118,2cyclictest863-21systemd-logind23:07:060
294082210,0sleep20-21swapper/222:44:592
219192210,0sleep021911-21id00:17:100
173642210,0sleep0141rcuc/021:35:410
80862200,1sleep0941-21sshd23:14:440
5462992014,4cyclictest19767-21sshd23:34:211
545699192,2cyclictest121rcu_sched22:36:410
199782190,2sleep1241rcuc/122:53:201
157502190,1sleep015745-21systemd22:01:550
132172190,1sleep113213-21grepconf.sh23:13:331
5473991814,3cyclictest32713-21sshd22:48:083
547399180,6cyclictest25185-21bash22:28:413
546899180,17cyclictest0-21swapper/219:23:512
294382180,1sleep129415-21bash23:05:271
5473991714,2cyclictest20804-21systemd-cgroups21:22:383
547399170,15cyclictest0-21swapper/319:26:393
546899175,11cyclictest1-21systemd00:10:222
546899170,16cyclictest0-21swapper/223:36:522
546299172,14cyclictest0-21swapper/121:35:181
546299170,2cyclictest858-21dbus-daemon22:08:501
546299170,16cyclictest0-21swapper/120:17:521
5456991715,1cyclictest9-21ksoftirqd/021:19:090
269582170,1sleep0141rcuc/021:05:060
217272170,0sleep30-21swapper/321:18:123
14712170,1sleep01455-21sshd22:17:190
547399165,2cyclictest25781-21grepconf.sh23:12:383
547399165,2cyclictest19916-21cp23:28:323
547399162,10cyclictest29355-21systemd22:59:343
547399161,12cyclictest858-21dbus-daemon21:45:173
547399160,15cyclictest0-21swapper/320:27:223
547399160,15cyclictest0-21swapper/320:01:133
547399160,14cyclictest0-21swapper/300:27:593
546899164,11cyclictest20137-21bash23:15:182
546899164,10cyclictest916-21polkitd23:08:322
546899160,15cyclictest19857-21kworker/2:422:52:402
546899160,15cyclictest0-21swapper/223:43:582
546899160,15cyclictest0-21swapper/221:50:302
546899160,15cyclictest0-21swapper/220:27:072
546899160,15cyclictest0-21swapper/219:58:522
546899160,15cyclictest0-21swapper/219:30:152
546899160,15cyclictest0-21swapper/219:04:362
5462991614,1cyclictest32545-21sshd22:23:041
5462991613,2cyclictest6286-21sshd00:04:301
546299160,15cyclictest0-21swapper/122:15:521
546299160,15cyclictest0-21swapper/121:02:441
546299160,15cyclictest0-21swapper/119:45:461
546299160,15cyclictest0-21swapper/100:22:381
545699160,2cyclictest3392-21bash21:54:030
38072160,1sleep33806-21systemd-cgroups22:15:573
327132160,0sleep20-21swapper/222:58:182
547399152,1cyclictest858-21dbus-daemon23:07:213
5473991513,1cyclictest0-21swapper/300:00:523
547399150,14cyclictest0-21swapper/320:06:433
547399150,14cyclictest0-21swapper/319:43:213
547399150,13cyclictest0-21swapper/323:22:203
547399150,10cyclictest9834-21sshd00:31:583
5468991513,1cyclictest35-21ksoftirqd/223:33:172
5468991511,2cyclictest35-21ksoftirqd/222:36:142
546899150,14cyclictest0-21swapper/220:35:112
546899150,14cyclictest0-21swapper/220:18:312
546899150,13cyclictest3339-21kworker/2:100:27:432
546299153,2cyclictest863-21systemd-logind00:10:091
546299152,9cyclictest22407-21sshd23:24:121
546299150,14cyclictest12741-21expr22:54:251
546299150,14cyclictest0-21swapper/120:04:071
546299150,14cyclictest0-21swapper/119:34:151
546299150,14cyclictest0-21swapper/119:22:031
546299150,13cyclictest6922-21sshd00:30:141
546299150,13cyclictest0-21swapper/120:48:501
545699155,9cyclictest9-21ksoftirqd/000:31:210
545699154,10cyclictest863-21systemd-logind21:12:190
547399141,10cyclictest19726-21sshd23:31:263
5473991410,2cyclictest863-21systemd-logind21:32:413
5473991410,2cyclictest1398-21grepconf.sh22:02:433
547399140,13cyclictest10063-21sshd23:44:113
547399140,13cyclictest0-21swapper/320:37:443
5468991411,2cyclictest16712-21ystemctl21:16:292
546899140,13cyclictest0-21swapper/220:49:112
546899140,13cyclictest0-21swapper/219:24:162
546899140,13cyclictest0-21swapper/200:21:262
546899140,11cyclictest858-21dbus-daemon00:14:182
546299142,11cyclictest6403-21sshd23:45:241
5462991410,1cyclictest26867-21systemd-cgroups23:14:101
546299140,13cyclictest29856-21sshd21:53:471
546299140,13cyclictest28526-21bash23:39:081
546299140,13cyclictest0-21swapper/121:07:591
546299140,13cyclictest0-21swapper/120:12:281
546299140,13cyclictest0-21swapper/120:00:551
546299140,13cyclictest0-21swapper/119:57:401
545699143,1cyclictest28012-21sshd22:33:150
5456991412,1cyclictest9-21ksoftirqd/022:21:170
5456991412,1cyclictest10766-21latency_hist23:34:000
5456991411,2cyclictest26355-21sshd22:41:550
5456991411,1cyclictest9-21ksoftirqd/000:26:580
545699140,2cyclictest23041-21systemd00:11:090
302612140,1sleep030262-21uname21:30:240
547399138,4cyclictest23767-21sshd22:49:103
547399130,12cyclictest0-21swapper/319:47:103
547399130,12cyclictest0-21swapper/319:11:453
547399130,11cyclictest0-21swapper/320:43:443
547399130,10cyclictest1627-21gdbus22:09:093
546899139,2cyclictest21946-21bash21:59:192
546899130,12cyclictest0-21swapper/220:19:252
546299139,1cyclictest0-21swapper/100:17:371
546299130,12cyclictest0-21swapper/120:53:021
545699134,4cyclictest26674-21perf20:49:000
545699131,11cyclictest0-21swapper/019:52:310
545699131,10cyclictest858-21dbus-daemon23:50:060
545699130,3cyclictest9535-21sshd23:54:230
545699130,12cyclictest0-21swapper/021:00:410
545699130,12cyclictest0-21swapper/020:51:290
545699130,12cyclictest0-21swapper/020:34:080
545699130,12cyclictest0-21swapper/020:22:190
545699130,12cyclictest0-21swapper/020:11:250
545699130,12cyclictest0-21swapper/020:00:190
545699130,12cyclictest0-21swapper/019:45:070
545699130,12cyclictest0-21swapper/019:13:450
545699130,11cyclictest31394-21sshd00:04:130
547399129,1cyclictest0-21swapper/319:29:143
547399120,11cyclictest0-21swapper/319:53:073
547399120,11cyclictest0-21swapper/319:37:393
546899128,2cyclictest23282-21grepconf.sh22:59:192
546899120,11cyclictest0-21swapper/220:54:142
546899120,11cyclictest0-21swapper/220:41:172
546899120,10cyclictest0-21swapper/219:49:252
546299121,10cyclictest0-21swapper/119:06:061
546299120,11cyclictest0-21swapper/120:20:521
545699120,11cyclictest0-21swapper/020:56:230
545699120,11cyclictest0-21swapper/020:43:470
545699120,11cyclictest0-21swapper/019:56:490
545699120,11cyclictest0-21swapper/019:40:240
545699120,11cyclictest0-21swapper/019:24:160
545699120,10cyclictest12109-21fw_forwarded_lo19:14:150
547399110,9cyclictest0-21swapper/320:09:213
547399110,1cyclictest0-21swapper/320:44:153
547399110,1cyclictest0-21swapper/319:54:223
547399110,10cyclictest0-21swapper/320:29:163
547399110,10cyclictest0-21swapper/319:04:203
546899110,10cyclictest0-21swapper/220:59:262
546899110,10cyclictest0-21swapper/220:31:132
546299110,9cyclictest11762-21diskstats19:14:131
546299110,1cyclictest0-21swapper/119:09:021
546299110,10cyclictest0-21swapper/120:34:561
546299110,10cyclictest0-21swapper/119:51:161
545699119,1cyclictest0-21swapper/020:04:130
545699117,2cyclictest20130-21kworker/0:119:06:410
545699115,2cyclictest18834-21kworker/0:220:31:400
545699110,1cyclictest10487-21awk20:14:200
547399108,1cyclictest9915-21perl20:14:163
547399101,8cyclictest0-21swapper/320:56:293
547399100,9cyclictest28296-21postgres_users20:49:313
547399100,9cyclictest1952-21munin-run21:04:003
547399100,1cyclictest12390-21grep20:19:143
547399100,1cyclictest0-21swapper/319:14:133
546899108,1cyclictest8445-21df_inode19:09:012
546899108,1cyclictest0-21swapper/220:44:212
546899100,9cyclictest27805-21ntp_states19:44:182
546899100,9cyclictest0-21swapper/220:04:252
546899100,9cyclictest0-21swapper/219:59:152
546899100,9cyclictest0-21swapper/219:39:142
546899100,9cyclictest0-21swapper/219:14:142
546299108,1cyclictest0-21swapper/120:54:131
546299108,1cyclictest0-21swapper/119:39:131
546299100,1cyclictest22278-21diskstats20:39:131
546299100,1cyclictest19352-21diskstats19:29:131
546299100,1cyclictest15702-21postgres_users20:24:211
546299100,1cyclictest0-21swapper/120:29:171
546299100,1cyclictest0-21swapper/119:24:181
545699109,0cyclictest0-21swapper/020:24:280
545699107,2cyclictest20948-21kworker/0:019:34:180
545699100,9cyclictest0-21swapper/019:29:190
545699100,9cyclictest0-21swapper/019:19:160
54739990,0cyclictest0-21swapper/319:19:133
54689990,9cyclictest0-21swapper/219:34:152
54689990,0cyclictest0-21swapper/220:09:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional