You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2019-06-17 - 06:55

Intel(R) Xeon(R) CPU E3-1220L V2 @ 2.30GHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #9, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack9slot0.osadl.org (updated Mon Jun 17, 2019 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2005121640,2sleep21108399cyclictest21:50:232
2005121640,2sleep21108399cyclictest21:50:232
2074521310,2sleep31108499cyclictest22:15:183
2725421250,0sleep00-21swapper/023:39:010
2040021170,2sleep020402-21sshd21:33:260
423821160,0sleep00-21swapper/000:29:280
1410021120,2sleep21108399cyclictest21:31:512
239282790,2sleep123817-21sshd23:21:381
309162760,1sleep01655-21nfsd23:40:250
26402750,1sleep12600-21cp22:13:151
23832750,1sleep02360-21bash23:02:130
99492730,2sleep10-21swapper/121:17:231
84822720,1sleep38485-21bash22:52:023
42002720,1sleep14201-21sshd21:36:471
324782720,0sleep21-21systemd00:33:152
324782720,0sleep21-21systemd00:33:152
225492720,1sleep222486-21sshd00:06:172
191032720,0sleep00-21swapper/021:16:260
206632700,1sleep120656-21sshd21:55:391
63252690,1sleep26316-21grepconf.sh22:33:052
239682690,1sleep223963-21sshd23:08:282
18752690,2sleep01108199cyclictest23:55:010
184722680,0sleep30-21swapper/322:40:233
159562680,0sleep0141rcuc/023:34:280
30752650,1sleep3811-21dbus-daemon21:14:293
30752650,1sleep3811-21dbus-daemon21:14:293
186662650,0sleep218667-21sshd21:17:442
156152650,0sleep0101ktimersoftd/023:25:180
124372650,1sleep012400-21sshd23:46:070
106262650,0sleep010623-21sshd22:01:440
106262650,0sleep010623-21sshd22:01:440
59682640,0sleep30-21swapper/323:39:283
39042640,0sleep3421rcuc/323:11:343
295852640,0sleep229586-21systemd-cgroups23:24:362
172862620,0sleep3421rcuc/323:51:393
310992610,1sleep231070-21bash00:00:002
284852610,1sleep128462-21bash23:48:041
20942610,0sleep1241rcuc/122:58:171
195822610,1sleep0141rcuc/023:13:270
233002600,0sleep30-21swapper/323:00:243
281712590,1sleep0141rcuc/000:03:500
242662590,1sleep224260-21sshd23:29:332
313982580,0sleep30-21swapper/300:05:183
268932580,0sleep10-21swapper/122:43:181
259842570,0sleep125978-21sshd21:41:321
206442570,0sleep00-21swapper/022:33:390
46802560,0sleep20-21swapper/221:10:432
46802560,0sleep20-21swapper/221:10:432
46192560,2sleep21108399cyclictest00:34:432
35322560,0sleep00-21swapper/022:57:040
122182560,0sleep10-21swapper/122:00:291
122182560,0sleep10-21swapper/122:00:291
305402550,0sleep30-21swapper/322:35:263
245382530,1sleep00-21swapper/022:09:010
1069825324,9sleep20-21swapper/219:06:542
1081025036,8sleep30-21swapper/319:08:193
1079224923,8sleep00-21swapper/019:08:040
1087224834,8sleep10-21swapper/119:09:051
224352420,0sleep30-21swapper/323:47:503
11083993330,2cyclictest32635-21sshd21:48:172
11083993330,2cyclictest32635-21sshd21:48:172
1108299334,13cyclictest811-21dbus-daemon00:23:571
1108299305,8cyclictest2595-21grepconf.sh23:04:501
1108299300,2cyclictest811-21dbus-daemon21:51:471
1108299300,2cyclictest811-21dbus-daemon21:51:471
1108299300,12cyclictest15891-21grepconf.sh00:28:381
17672290,1sleep1241rcuc/122:21:131
174932290,2sleep317495-21grepconf.sh23:22:443
63042280,1sleep16301-21systemd-cgroups22:35:481
11083992826,1cyclictest35-21ksoftirqd/223:17:472
1108299288,10cyclictest837-21systemd-logind23:02:241
11083992716,1cyclictest35-21ksoftirqd/222:52:462
11083992711,1cyclictest35-21ksoftirqd/223:43:262
1108299275,9cyclictest1-21systemd21:09:411
1108299275,9cyclictest1-21systemd21:09:411
186262260,0sleep0141rcuc/022:37:480
11083992624,1cyclictest35-21ksoftirqd/223:02:442
11083992612,1cyclictest35-21ksoftirqd/222:17:182
1108299268,8cyclictest20584-21id23:25:301
11082992623,2cyclictest27785-21sshd00:06:291
94652250,1sleep3421rcuc/300:28:233
284782250,0sleep00-21swapper/022:47:220
189822250,1sleep3811-21dbus-daemon22:21:553
11083992516,1cyclictest35-21ksoftirqd/222:10:342
11083992510,1cyclictest35-21ksoftirqd/200:11:202
1108299254,9cyclictest28101-21uname00:17:041
1108299254,9cyclictest28101-21uname00:17:041
1108299254,9cyclictest22321-21kill22:52:371
11082992522,2cyclictest19417-21sshd22:17:571
1108399249,1cyclictest35-21ksoftirqd/200:16:512
1108399249,1cyclictest35-21ksoftirqd/200:16:512
1108399248,2cyclictest35-21ksoftirqd/221:40:392
11083992413,3cyclictest35-21ksoftirqd/221:27:172
11083992412,1cyclictest35-21ksoftirqd/223:57:562
1108399241,1cyclictest35-21ksoftirqd/222:06:162
1108299242,11cyclictest19397-21sshd22:08:501
256252230,2sleep025621-21grepconf.sh00:07:470
1108399239,2cyclictest121rcu_sched00:26:232
11083992319,1cyclictest35-21ksoftirqd/222:24:472
1108299235,7cyclictest28092-21sshd00:11:531
1108299234,8cyclictest10020-21bash22:31:551
1108299233,8cyclictest27182-21grep21:48:041
1108299233,8cyclictest27182-21grep21:48:041
1108299233,8cyclictest26336-21grepconf.sh00:02:281
1108299233,8cyclictest16326-21grepconf.sh22:49:351
300592220,0sleep20-21swapper/219:44:382
14342220,2sleep31437-21grep21:52:213
14342220,2sleep31437-21grep21:52:213
1108399229,1cyclictest35-21ksoftirqd/221:56:532
11083992220,1cyclictest35-21ksoftirqd/223:51:452
11083992220,1cyclictest35-21ksoftirqd/222:55:042
11083992219,1cyclictest35-21ksoftirqd/223:47:082
11083992212,1cyclictest35-21ksoftirqd/221:21:562
1108399220,1cyclictest88350irq/26-p4p1-rx-22:35:552
1108299228,9cyclictest4340-21bash23:38:011
1108299226,7cyclictest22585-21sshd21:33:301
1108299223,8cyclictest7183-21rm23:16:521
1108299223,8cyclictest10614-21bash00:34:571
1108299222,9cyclictest459-21uname21:27:261
11082992218,3cyclictest3095-21bash23:44:261
1108299220,2cyclictest3863-21uname23:55:051
105002220,1sleep21-21systemd22:03:022
105002220,1sleep21-21systemd22:03:022
48092210,2sleep388450irq/27-p4p1-tx-23:30:023
170292210,1sleep117023-21sshd23:10:481
1108399216,1cyclictest35-21ksoftirqd/222:43:492
1108399216,10cyclictest35-21ksoftirqd/221:39:022
1108399215,1cyclictest35-21ksoftirqd/223:31:412
1108399214,5cyclictest35-21ksoftirqd/223:10:322
1108399214,2cyclictest848-21NetworkManager23:39:082
11083992118,2cyclictest35-21ksoftirqd/200:19:412
1108399210,1cyclictest121rcu_sched22:45:032
1108299211,10cyclictest23720-21bash23:30:491
1108299210,18cyclictest0-21swapper/119:19:431
13392200,1sleep31337-21bash21:31:203
1108399208,1cyclictest35-21ksoftirqd/222:22:112
1108299203,8cyclictest1-21systemd21:22:341
1108299200,2cyclictest21818-21systemd00:31:281
1108299200,2cyclictest21818-21systemd00:31:281
1108299200,1cyclictest0-21swapper/122:25:251
277342190,0sleep00-21swapper/021:14:100
277342190,0sleep00-21swapper/021:14:100
218242190,2sleep31108499cyclictest19:26:493
183112190,0sleep318314-21id21:28:083
140572190,1sleep014052-21sshd23:06:420
11084991916,2cyclictest13965-21sshd21:47:323
11084991916,2cyclictest13965-21sshd21:47:323
1108299193,7cyclictest9851-21bash23:49:571
1108199194,10cyclictest31803-21systemd00:33:130
1108199194,10cyclictest31803-21systemd00:33:130
11081991913,4cyclictest26494-21sshd00:11:490
11081991911,7cyclictest24352-21sshd23:17:340
11081991911,7cyclictest12083-21rm22:16:180
11081991910,8cyclictest1-21systemd21:48:080
11081991910,8cyclictest1-21systemd21:48:080
1108199190,11cyclictest18655-21sshd22:23:190
1108199190,11cyclictest18350-21sshd21:56:510
110172190,2sleep31-21systemd22:31:573
11084991816,1cyclictest12934-21sshd00:00:353
1108199189,2cyclictest23144-21systemd-cgroups23:50:310
1108199188,2cyclictest2112-21sshd22:50:200
1108199182,15cyclictest888-21gdbus00:19:470
11081991811,6cyclictest888-21gdbus21:38:030
1108199181,16cyclictest0-21swapper/022:11:470
11081991810,7cyclictest21651-21sshd21:53:120
11081991810,7cyclictest21651-21sshd21:53:120
1108199180,2cyclictest27978-21id23:24:330
1108199180,2cyclictest16761-21grep00:36:350
1108199180,2cyclictest14615-21sshd22:40:140
1108199180,1cyclictest10477-21sshd00:15:000
1108199180,1cyclictest10477-21sshd00:15:000
1108199180,11cyclictest4662-21sshd21:40:420
1108199180,11cyclictest10966-21grep21:20:020
1108199180,10cyclictest19597-21grepconf.sh21:28:110
26282170,2sleep31-21systemd23:41:533
1108499173,13cyclictest0-21swapper/300:18:273
1108499173,13cyclictest0-21swapper/300:18:273
1108499170,15cyclictest0-21swapper/322:47:153
1108399170,0cyclictest0-21swapper/219:19:412
1108199170,2cyclictest4676-21grepconf.sh22:25:150
1108499164,11cyclictest2524-21cp23:24:483
1108499164,10cyclictest886-21polkitd23:14:423
11084991612,3cyclictest29337-21grepconf.sh21:39:073
11084991611,4cyclictest0-21swapper/322:12:593
11084991611,1cyclictest44-21ksoftirqd/322:26:253
11084991513,1cyclictest44-21ksoftirqd/300:22:363
11084991513,1cyclictest44-21ksoftirqd/300:11:453
11084991511,2cyclictest837-21systemd-logind21:55:183
1108499150,2cyclictest3068-21bash22:08:123
1108499150,11cyclictest0-21swapper/321:24:113
1108499149,4cyclictest44-21ksoftirqd/321:15:473
1108499143,10cyclictest834-21avahi-daemon00:33:283
1108499143,10cyclictest834-21avahi-daemon00:33:283
1108499142,1cyclictest121rcu_sched23:08:033
1108499142,10cyclictest811-21dbus-daemon22:57:003
11084991411,2cyclictest16948-21sshd22:00:403
11084991411,2cyclictest16948-21sshd22:00:403
1108499140,1cyclictest0-21swapper/323:55:303
1108499140,12cyclictest24683-21bash00:35:333
1108499140,12cyclictest17436-21sshd21:39:533
1108299142,9cyclictest8547-21chrt21:07:371
11082991410,3cyclictest0-21swapper/121:00:051
285052130,0sleep10-21swapper/120:44:381
1108299132,7cyclictest26093-21expr19:34:461
1108299130,0cyclictest0-21swapper/119:51:331
1108199138,1cyclictest1655-21nfsd21:04:400
1108299122,6cyclictest29732-21taskset19:44:241
1108199129,0cyclictest0-21swapper/019:19:530
1108199128,0cyclictest0-21swapper/020:20:310
11084991110,0cyclictest0-21swapper/320:00:553
1108399110,0cyclictest0-21swapper/220:49:452
1108399110,0cyclictest0-21swapper/220:29:462
1108299117,3cyclictest0-21swapper/120:57:321
1108299113,7cyclictest26168-21expr20:39:391
1108299113,7cyclictest21429-21cat19:24:511
1108299112,8cyclictest31847-21sed20:49:421
1108299112,8cyclictest10650irq/24-ahci[00020:09:471
1108299110,1cyclictest2011-21runrttasks19:09:481
1108299110,1cyclictest14150-21ntp_offset19:14:381
1108299110,1cyclictest0-21swapper/119:34:361
1108199118,0cyclictest0-21swapper/019:46:360
1108199110,10cyclictest0-21swapper/020:16:140
1108499109,0cyclictest0-21swapper/320:31:563
1108499109,0cyclictest0-21swapper/319:47:193
1108499100,9cyclictest0-21swapper/320:59:003
1108499100,0cyclictest0-21swapper/320:50:103
1108499100,0cyclictest0-21swapper/320:27:033
1108499100,0cyclictest0-21swapper/320:22:103
1108499100,0cyclictest0-21swapper/319:38:513
1108399109,0cyclictest15342-21runrttasks20:19:052
1108399108,1cyclictest3496-21fw_conntrack19:54:412
1108399100,9cyclictest0-21swapper/221:00:262
1108399100,9cyclictest0-21swapper/219:37:582
1108399100,0cyclictest0-21swapper/220:36:282
1108399100,0cyclictest0-21swapper/220:23:162
1108399100,0cyclictest0-21swapper/220:02:522
1108399100,0cyclictest0-21swapper/219:29:012
1108299101,8cyclictest830-21rngd20:19:391
1108299100,2cyclictest6142-21sed19:59:421
1108299100,2cyclictest24154-21tail20:34:421
1108299100,2cyclictest14296-21awk20:14:471
1108299100,1cyclictest8718-21grep20:04:431
1108299100,1cyclictest21159-21grep20:29:401
1108299100,1cyclictest18160-21/usr/sbin/munin20:24:471
1108299100,1cyclictest1421-21lldpd19:46:061
1108199109,0cyclictest0-21swapper/020:48:450
1108199109,0cyclictest0-21swapper/019:25:280
1108199100,9cyclictest0-21swapper/019:42:390
1108199100,5cyclictest0-21swapper/020:24:440
1108199100,0cyclictest0-21swapper/020:51:190
1108199100,0cyclictest0-21swapper/020:32:150
1108199100,0cyclictest0-21swapper/020:02:100
1108199100,0cyclictest0-21swapper/019:38:420
110849992,2cyclictest0-21swapper/320:59:433
110839997,1cyclictest88250irq/25-em119:51:492
110839991,1cyclictest35-21ksoftirqd/219:14:372
110829990,1cyclictest2817-21wget19:54:381
110819998,0cyclictest0-21swapper/019:16:170
110849987,0cyclictest0-21swapper/320:47:373
110849987,0cyclictest0-21swapper/320:38:473
110849987,0cyclictest0-21swapper/319:16:393
110849982,2cyclictest0-21swapper/321:04:443
110849981,2cyclictest0-21swapper/320:14:443
110839981,1cyclictest88350irq/26-p4p1-rx-19:39:422
110819987,0cyclictest0-21swapper/020:07:380
110819987,0cyclictest0-21swapper/019:50:330
110819987,0cyclictest0-21swapper/019:12:410
110819981,1cyclictest26870-21ipmitool20:39:430
110849976,0cyclictest0-21swapper/319:19:383
110849974,2cyclictest908-21fw_conntrack19:49:423
110849972,1cyclictest0-21swapper/320:40:493
110849970,2cyclictest0-21swapper/320:04:443
110849970,2cyclictest0-21swapper/319:29:443
110849970,1cyclictest28229-21gltestperf19:39:423
110849970,1cyclictest11883-21ntp_states20:09:483
110839975,1cyclictest18777-21fschecks_time20:24:412
110839974,2cyclictest1364-21cpuspeed_turbos20:54:392
110839971,2cyclictest35-21ksoftirqd/219:14:382
110839970,2cyclictest0-21swapper/221:04:442
110839970,1cyclictest28888-21entropy20:44:402
110839970,1cyclictest22679-21df_abs19:29:392
110839970,1cyclictest0-21swapper/220:39:422
110839970,0cyclictest0-21swapper/220:10:012
110839970,0cyclictest0-21swapper/220:04:382
110819970,6cyclictest0-21swapper/020:10:170
110819970,1cyclictest23132-21hddtemp_smartct19:29:420
110819970,1cyclictest0-21swapper/020:34:400
110819970,1cyclictest0-21swapper/019:54:540
110849960,2cyclictest0-21swapper/319:55:053
110849960,2cyclictest0-21swapper/319:09:443
110819964,1cyclictest2139-21/usr/sbin/munin20:54:430
110819962,2cyclictest0-21swapper/020:59:440
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional