You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-30 - 19:19

x86 Intel Xeon E3-1220 @3100 MHz, Linux 4.19.8-rt6 (Profile)

Latency plot of system in rack #1, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 100, Linux 4.9.20-rt16, x86_64 highest latencies:
System rack1slot0.osadl.org (updated Thu Jun 30, 2022 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
315792850,0sleep131575-21lspci12:27:221
259172680,0sleep225892-21sshd10:25:242
223362630,0sleep20-21swapper/210:20:152
185892630,0sleep3391rcuc/310:02:333
31892620,0sleep10-21swapper/111:18:111
114332620,2sleep11117299cyclictest10:26:471
314632610,2sleep131442-21bash12:24:541
259852610,0sleep00-21swapper/012:19:280
151272610,0sleep00-21swapper/010:34:310
140002610,0sleep20-21swapper/209:49:542
140002610,0sleep20-21swapper/209:49:542
7602600,0sleep20-21swapper/210:43:182
38372600,0sleep20-21swapper/210:06:212
305592600,0sleep10-21swapper/109:16:041
297402600,1sleep0111rcuc/011:02:510
297402600,1sleep0111rcuc/011:02:510
279272600,0sleep20-21swapper/209:33:352
199162600,1sleep219910-21bash12:14:012
29322590,0sleep10-21swapper/109:53:581
205092590,0sleep00-21swapper/012:29:010
1102125948,7sleep20-21swapper/207:09:342
82052580,0sleep28202-21lspci11:33:222
136622580,0sleep11-21systemd11:09:051
1101225734,7sleep00-21swapper/007:09:290
69212560,0sleep10-21swapper/110:01:391
308262560,0sleep00-21swapper/011:32:360
260672560,0sleep10-21swapper/111:42:111
254792560,0sleep10-21swapper/112:36:511
175982560,1sleep017594-21lspci10:59:310
289612550,0sleep028963-21grepconf.sh11:05:160
240172550,1sleep024012-21sshd12:34:180
267752540,0sleep00-21swapper/009:10:060
229592540,1sleep3820-21dbus-daemon11:17:133
113822540,0sleep20-21swapper/209:19:412
1098725342,7sleep30-21swapper/307:09:153
1073925130,4sleep10-21swapper/107:06:251
85372480,1sleep341-21ksoftirqd/312:15:343
153082470,2sleep31118699cyclictest10:07:143
58802460,1sleep21-21systemd10:56:042
126882430,0sleep00-21swapper/012:20:530
320402400,0sleep132045-21bash11:20:191
62482310,1sleep3401ktimersoftd/310:28:533
219782250,0sleep021977-21seq09:23:040
119142250,0sleep10-21swapper/110:39:131
129782240,1sleep0101ktimersoftd/010:17:000
282812200,0sleep10-21swapper/109:43:321
282812200,0sleep10-21swapper/109:43:321
99962190,0sleep09998-21bash10:51:260
63292190,0sleep00-21swapper/009:46:470
63292190,0sleep00-21swapper/009:46:470
306492190,0sleep20-21swapper/211:52:252
267952190,0sleep30-21swapper/309:55:443
6192180,1sleep1618-21grep10:21:021
277372180,1sleep327726-21cp11:02:423
277372180,1sleep327726-21cp11:02:423
123932180,0sleep10-21swapper/110:31:481
123682170,0sleep1241ktimersoftd/111:46:031
11167991710,3cyclictest9-21ksoftirqd/010:05:000
33342160,1sleep0820-21dbus-daemon09:44:070
33342160,1sleep0820-21dbus-daemon09:44:060
323422160,0sleep30-21swapper/310:18:313
275152160,0sleep10-21swapper/110:05:391
53162150,11sleep395750irq/24-eno1-rx-10:13:593
43532150,0sleep10-21swapper/109:59:021
164062150,0sleep20-21swapper/209:12:282
11167991513,1cyclictest6264-21kworker/0:211:29:540
7012140,1sleep2697-21sshd12:35:012
127572140,0sleep30-21swapper/312:05:573
11179991412,1cyclictest0-21swapper/210:48:522
1116799140,13cyclictest18351-21kworker/0:410:45:140
59132130,0sleep10-21swapper/111:35:391
11167991311,1cyclictest26159-21kworker/0:309:16:060
11167991311,1cyclictest18351-21kworker/0:410:42:450
11167991310,2cyclictest16466-21grep11:24:090
11167991310,0cyclictest27084-21kworker/0:209:54:430
11186991210,1cyclictest801-21systemd-logind09:27:163
11186991210,1cyclictest1-21systemd10:51:343
11186991210,1cyclictest0-21swapper/311:06:253
1118699120,1cyclictest0-21swapper/312:01:383
1118699120,11cyclictest6066-21nscd09:11:573
1118699120,11cyclictest31639-21bash09:48:453
1118699120,11cyclictest31639-21bash09:48:453
1118699120,11cyclictest22501-21id09:20:303
1118699120,11cyclictest19101-21sshd11:39:113
1118699120,11cyclictest17157-21rm12:33:463
1118699120,11cyclictest1-21systemd10:47:223
11179991210,1cyclictest909-21NetworkManager09:36:422
11179991210,1cyclictest0-21swapper/211:28:452
1117999120,11cyclictest801-21systemd-logind10:32:342
1117299120,1cyclictest531-21grep12:15:011
1116799129,2cyclictest13967-21sshd11:56:070
11167991210,1cyclictest820-21dbus-daemon12:10:590
11167991210,1cyclictest0-21swapper/011:44:390
1116799120,1cyclictest0-21swapper/009:29:210
1116799120,11cyclictest0-21swapper/009:35:290
77532110,0sleep20-21swapper/212:03:072
263232110,2sleep21117999cyclictest09:28:312
112222110,1sleep311225-21grep09:34:493
1118699119,1cyclictest22163-21lspci12:36:363
1118699110,10cyclictest0-21swapper/311:47:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional