You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-07-29 - 04:21

Intel(R) Xeon(R) CPU E3-1220L V2 @ 2.30GHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #a, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 100 highest latencies:
System rackaslot0.osadl.org (updated Thu Jul 29, 2021 00:44:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
172862610,1sleep317287-21sshd23:47:203
1333926023,19sleep20-21swapper/219:08:232
1321625923,18sleep30-21swapper/319:06:483
97002570,1sleep19702-21kernelversion00:00:231
86892570,0sleep21714-21runrttasks23:41:142
220822570,0sleep322011-21sshd23:05:133
5052560,2sleep119-21rcuc/123:11:281
5052560,2sleep119-21rcuc/123:11:281
30142560,1sleep20-21swapper/200:08:592
27282530,1sleep00-21swapper/022:57:290
178542530,0sleep30-21swapper/322:16:343
161042530,0sleep30-21swapper/323:51:493
232432520,0sleep00-21swapper/023:05:180
178282520,0sleep20-21swapper/223:52:032
16232510,0sleep21620-21bash00:13:272
202072490,0sleep320199-21sshd23:33:333
146662480,0sleep26423-21diskmemload22:54:312
242252470,0sleep10-21swapper/122:41:201
154342470,0sleep20-21swapper/222:01:062
1131224725,18sleep00-21swapper/019:05:010
1317024624,19sleep10-21swapper/119:06:151
150752440,0sleep10-21swapper/123:28:031
267212420,0sleep30-21swapper/322:22:393
64052410,2sleep01372599cyclictest23:45:360
252862390,0sleep30-21swapper/321:37:443
1372599250,1cyclictest4150-21sshd22:33:380
1372599220,17cyclictest0-21swapper/021:11:270
1372599210,9cyclictest0-21swapper/023:21:530
1372599210,14cyclictest0-21swapper/021:49:270
1372799200,1cyclictest6423-21diskmemload23:34:552
1372599208,8cyclictest0-21swapper/022:08:060
1372599208,7cyclictest0-21swapper/000:30:050
1372599201,18cyclictest0-21swapper/023:50:020
1372599200,4cyclictest0-21swapper/023:59:020
1372599200,3cyclictest1714-21runrttasks21:52:040
1372899191,10cyclictest0-21swapper/323:01:333
1372599199,1cyclictest0-21swapper/023:17:510
1372599199,1cyclictest0-21swapper/022:13:340
1372599190,18cyclictest0-21swapper/000:00:020
1372599190,10cyclictest17960-21bash22:16:350
1372599190,10cyclictest15118-21sshd22:01:040
1372899184,6cyclictest31572-21sshd21:23:553
13728991817,1cyclictest114850irq/25-eth022:26:383
1372899180,6cyclictest0-21swapper/300:26:443
1372599181,2cyclictest0-21swapper/019:15:020
13725991810,1cyclictest0-21swapper/023:04:190
1372599180,17cyclictest4744-21sshd00:28:050
1372599180,11cyclictest0-21swapper/023:10:220
1372599180,11cyclictest0-21swapper/023:10:220
1372599180,10cyclictest0-21swapper/021:40:580
117862180,0sleep20-21swapper/222:44:252
1372899176,3cyclictest0-21swapper/300:16:393
1372599179,7cyclictest0-21swapper/022:29:110
1372599179,2cyclictest0-21swapper/022:21:070
1372599179,1cyclictest0-21swapper/023:35:280
1372599178,7cyclictest0-21swapper/000:11:350
1372599178,3cyclictest0-21swapper/022:40:130
1372599178,2cyclictest32558-21sshd21:28:570
1372599178,2cyclictest0-21swapper/023:26:270
1372599178,1cyclictest27145-21sshd00:17:040
1372599178,1cyclictest15101-21bash22:54:350
1372599177,2cyclictest16930-21sshd23:42:300
1372599170,16cyclictest0-21swapper/023:34:290
1372599170,16cyclictest0-21swapper/000:35:160
1372599170,11cyclictest0-21swapper/022:49:440
1372599170,10cyclictest0-21swapper/021:39:580
1372899169,6cyclictest0-21swapper/322:39:023
1372899164,5cyclictest0-21swapper/300:35:313
1372899164,4cyclictest0-21swapper/323:58:473
1372899162,10cyclictest0-21swapper/323:37:283
1372899160,9cyclictest0-21swapper/320:18:573
13726991615,1cyclictest5917-21sshd21:14:551
1372599169,6cyclictest0-21swapper/000:07:030
1372599169,1cyclictest0-21swapper/021:24:240
1372599168,7cyclictest0-21swapper/000:22:070
1372599168,2cyclictest0-21swapper/021:55:290
13725991610,1cyclictest0-21swapper/020:37:530
1372599160,9cyclictest8777-21munin-node21:15:260
1372599160,2cyclictest0-21swapper/021:30:250
1372599160,11cyclictest0-21swapper/022:36:110
13162160,1sleep10-21swapper/122:14:151
118982160,0sleep337-21rcuc/322:44:263
1372899153,4cyclictest0-21swapper/322:54:273
13728991511,4cyclictest0-21swapper/322:55:523
1372899150,3cyclictest0-21swapper/319:20:073
1372699155,1cyclictest21-21ksoftirqd/122:38:141
1372699152,2cyclictest21-21ksoftirqd/123:09:501
1372599150,1cyclictest0-21swapper/019:29:140
1372599150,11cyclictest0-21swapper/021:05:180
38792140,0sleep20-21swapper/223:21:352
275872140,1sleep31714-21runrttasks19:35:243
1372899143,3cyclictest0-21swapper/322:47:233
1372899141,9cyclictest0-21swapper/322:05:413
1372899141,12cyclictest0-21swapper/321:15:083
1372899140,13cyclictest0-21swapper/320:05:233
1372899140,10cyclictest0-21swapper/320:33:593
1372799149,4cyclictest0-21swapper/221:22:492
1372799142,11cyclictest0-21swapper/221:52:042
1372799140,13cyclictest0-21swapper/221:46:522
1372799140,13cyclictest0-21swapper/200:15:092
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional