You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-29 - 09:46

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #8, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack8slot0.osadl.org (updated Wed Jun 29, 2022 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
948621270,1sleep3857-21dbus-daemon00:08:003
2040021230,1sleep220401-21sshd00:22:392
2128421210,1sleep121264-21sshd23:17:061
298321200,1sleep10-21swapper/122:29:351
1863221120,1sleep3746899cyclictest21:46:433
1549721110,0sleep30-21swapper/323:37:133
261821090,1sleep12621-21sshd22:04:491
3027721080,0sleep00-21swapper/023:26:120
152212900,2sleep31-21systemd21:23:143
152212900,2sleep31-21systemd21:23:143
95742850,1sleep19555-21sshd22:37:051
36222850,2sleep0746599cyclictest22:06:210
148062850,1sleep2331rcuc/223:59:092
22392830,2sleep02234-21grep23:57:070
97422810,1sleep19714-21bash23:57:281
198172810,0sleep00-21swapper/023:59:230
317982800,1sleep21-21systemd22:33:412
134412800,1sleep313437-21sshd21:55:133
87372790,1sleep2331rcuc/221:44:502
308712790,0sleep00-21swapper/022:10:300
124862790,0sleep10-21swapper/123:19:311
124382790,0sleep312436-21sshd23:29:473
245062770,1sleep2331rcuc/221:09:092
231482770,2sleep123083-21sshd22:39:051
18852750,1sleep0141rcuc/021:24:070
18852750,1sleep0141rcuc/021:24:070
96922740,0sleep30-21swapper/321:09:593
292982740,1sleep129292-21sshd21:29:411
64322730,1sleep0923-21polkitd21:05:260
225132730,0sleep222481-21sshd22:45:002
312232720,1sleep0141rcuc/022:43:540
194672720,0sleep2331rcuc/223:01:042
178882710,0sleep20-21swapper/200:13:042
82062700,0sleep30-21swapper/323:02:013
6742700,1sleep1668-21sshd21:44:291
238432690,1sleep123838-21sshd23:41:561
38372680,1sleep0606-21systemd-journal22:32:310
263242680,0sleep20-21swapper/222:08:472
213512680,0sleep00-21swapper/023:50:330
310652670,1sleep231068-21systemd-cgroups22:54:022
191282670,1sleep319129-21grepconf.sh22:08:283
125922670,1sleep112556-21sshd22:54:411
25732660,1sleep2857-21dbus-daemon00:10:442
215512660,1sleep0141rcuc/000:27:180
150172660,0sleep30-21swapper/323:23:583
106392660,1sleep2331rcuc/223:42:492
85412650,0sleep3421rcuc/322:57:363
40622650,1sleep04061-21grepconf.sh00:07:450
275912650,1sleep21846-21nfsd22:23:192
121822650,1sleep012179-21grepconf.sh22:21:120
48462640,1sleep04844-21sshd23:22:070
303682640,0sleep30-21swapper/323:14:363
246012640,0sleep11-21systemd21:04:471
211092640,1sleep21-21systemd23:31:432
40132630,1sleep24011-21grepconf.sh23:20:362
304722630,1sleep0857-21dbus-daemon21:50:050
24682630,1sleep02469-21bash21:15:250
12722630,2sleep01269-21grep21:18:130
256262620,0sleep2331rcuc/223:37:402
309902610,0sleep30-21swapper/300:27:453
177212610,2sleep117710-21bash00:28:351
145882610,0sleep30-21swapper/322:46:053
29752600,1sleep3431ktimersoftd/322:03:233
272302600,1sleep127237-21bash21:26:481
272302600,1sleep127237-21bash21:26:481
124022600,1sleep227936-21kworker/2:022:51:452
124022600,1sleep227936-21kworker/2:022:51:452
26712570,1sleep12665-21sshd00:21:451
74392560,2sleep2746799cyclictest22:05:022
688425628,8sleep20-21swapper/218:58:502
172532560,5sleep1241rcuc/121:20:231
87052550,1sleep08695-21sshd23:09:120
700625527,8sleep00-21swapper/019:00:240
703125427,9sleep10-21swapper/119:00:411
235222540,0sleep10-21swapper/123:52:071
216302540,2sleep221627-21systemd00:24:112
134252540,0sleep30-21swapper/320:58:163
92552530,0sleep00-21swapper/020:48:070
236992520,1sleep344-21ksoftirqd/300:32:103
203552520,0sleep2331rcuc/219:38:192
697424329,8sleep30-21swapper/318:59:593
4932320,1sleep1462-21sshd21:34:141
30222320,1sleep03024-21bash23:27:560
250932320,1sleep11846-21nfsd23:01:191
207322300,1sleep020729-21bash00:14:430
7465992825,1cyclictest9-21ksoftirqd/022:40:520
7467992719,3cyclictest35-21ksoftirqd/223:14:012
746799250,2cyclictest32225-21grep21:53:072
746799250,1cyclictest952-21sshd23:10:312
7465992510,2cyclictest9-21ksoftirqd/021:58:110
225912250,1sleep222589-21sshd23:25:502
86752240,1sleep08644-21sshd23:36:540
7467992411,3cyclictest35-21ksoftirqd/221:16:162
7466992421,1cyclictest26-21ksoftirqd/122:18:421
746599248,1cyclictest121rcu_sched21:57:110
7465992422,1cyclictest9-21ksoftirqd/023:44:280
7465992421,1cyclictest9-21ksoftirqd/022:54:300
7465992421,1cyclictest9-21ksoftirqd/022:27:260
746799239,3cyclictest35-21ksoftirqd/221:33:042
746799239,1cyclictest35-21ksoftirqd/221:05:392
746799232,1cyclictest341ktimersoftd/223:53:292
7467992311,3cyclictest35-21ksoftirqd/200:28:302
7465992322,0cyclictest9-21ksoftirqd/023:14:520
41522230,0sleep10-21swapper/122:26:421
94022220,0sleep00-21swapper/021:28:480
746799229,3cyclictest35-21ksoftirqd/223:49:322
746799222,1cyclictest341ktimersoftd/223:04:162
746799222,1cyclictest341ktimersoftd/222:29:112
746799222,1cyclictest341ktimersoftd/221:48:492
7467992210,3cyclictest35-21ksoftirqd/200:06:552
7467992210,2cyclictest35-21ksoftirqd/222:02:022
7465992219,1cyclictest9-21ksoftirqd/022:52:420
7465992219,1cyclictest9-21ksoftirqd/022:52:420
7465992218,2cyclictest9-21ksoftirqd/021:39:500
7465992218,1cyclictest9-21ksoftirqd/021:42:580
7465992210,3cyclictest9-21ksoftirqd/000:31:270
7465992210,1cyclictest9-21ksoftirqd/023:38:570
42572220,0sleep30-21swapper/321:32:563
178922220,0sleep00-21swapper/021:35:010
7467992113,3cyclictest35-21ksoftirqd/221:38:542
7465992119,1cyclictest9-21ksoftirqd/021:08:210
7465992119,1cyclictest9-21ksoftirqd/000:20:420
7465992118,2cyclictest9-21ksoftirqd/000:08:110
7465992116,1cyclictest9-21ksoftirqd/023:05:080
20032210,0sleep3421rcuc/322:52:473
20032210,0sleep3421rcuc/322:52:473
94162200,1sleep1241rcuc/121:38:591
7468992018,1cyclictest44-21ksoftirqd/300:22:503
746799207,1cyclictest35-21ksoftirqd/223:45:192
746799202,2cyclictest341ktimersoftd/221:21:182
746799201,3cyclictest35-21ksoftirqd/222:16:422
746799201,3cyclictest25655-21bash21:30:582
746799201,2cyclictest11574-21grep22:19:422
746799201,1cyclictest35-21ksoftirqd/221:23:022
746799201,1cyclictest35-21ksoftirqd/221:23:022
7467992010,4cyclictest35-21ksoftirqd/222:41:542
7466992018,1cyclictest26-21ksoftirqd/123:43:101
7466992017,1cyclictest26-21ksoftirqd/123:06:311
7466992016,2cyclictest26-21ksoftirqd/123:28:351
746699200,18cyclictest8615-21kworker/1:623:37:041
746599208,2cyclictest9-21ksoftirqd/022:14:570
7465992015,1cyclictest9-21ksoftirqd/022:36:150
226222200,2sleep322623-21grep22:42:043
196662200,1sleep319667-21grep00:00:593
163672200,1sleep016365-21bash22:59:250
746699192,1cyclictest121rcu_sched21:16:551
7466991917,1cyclictest26-21ksoftirqd/121:08:131
7466991917,1cyclictest26-21ksoftirqd/100:16:211
161052190,0sleep10-21swapper/100:08:141
7468991816,1cyclictest92150irq/27-p4p1-tx-23:09:253
7468991815,2cyclictest44-21ksoftirqd/321:49:153
7468991813,1cyclictest44-21ksoftirqd/322:35:463
7466991815,2cyclictest26-21ksoftirqd/122:11:041
7466991815,1cyclictest26-21ksoftirqd/123:59:371
7466991815,1cyclictest26-21ksoftirqd/122:51:281
7466991815,1cyclictest26-21ksoftirqd/122:51:281
7466991815,1cyclictest26-21ksoftirqd/121:56:031
7466991814,2cyclictest26-21ksoftirqd/123:08:041
7466991814,1cyclictest26-21ksoftirqd/100:24:491
230962180,0sleep30-21swapper/322:15:583
112742180,2sleep3746899cyclictest21:31:483
746899177,9cyclictest44-21ksoftirqd/322:31:143
7468991715,1cyclictest857-21dbus-daemon23:41:423
7468991715,1cyclictest44-21ksoftirqd/322:27:383
7468991715,1cyclictest44-21ksoftirqd/300:16:273
7466991715,1cyclictest26-21ksoftirqd/122:43:121
7466991715,1cyclictest26-21ksoftirqd/100:02:571
746699170,16cyclictest14670-21kworker/1:322:14:371
7465991715,1cyclictest9-21ksoftirqd/021:02:500
183512170,0sleep30-21swapper/323:47:363
746899168,5cyclictest21106-21sshd23:56:293
7468991614,1cyclictest44-21ksoftirqd/323:48:343
7468991614,1cyclictest44-21ksoftirqd/322:18:253
7468991613,1cyclictest44-21ksoftirqd/321:58:013
7468991613,1cyclictest44-21ksoftirqd/321:20:223
7468991611,2cyclictest20442-21sshd00:03:583
746899160,14cyclictest20610-21kworker/3:321:39:403
7466991614,1cyclictest26-21ksoftirqd/123:23:221
7466991614,1cyclictest26-21ksoftirqd/121:58:511
7466991611,4cyclictest26-21ksoftirqd/121:51:121
746899152,1cyclictest0-21swapper/321:17:213
7468991512,1cyclictest44-21ksoftirqd/323:18:223
7468991512,1cyclictest44-21ksoftirqd/323:06:543
746899151,11cyclictest0-21swapper/321:02:593
746799149,2cyclictest35-21ksoftirqd/221:02:502
746699120,2cyclictest26476-21cut19:58:161
746699120,10cyclictest14578-21kill21:02:501
7465991210,1cyclictest0-21swapper/019:48:150
746899111,1cyclictest0-21swapper/319:07:513
746799119,1cyclictest0-21swapper/219:07:522
746799110,1cyclictest0-21swapper/220:48:112
746699110,1cyclictest0-21swapper/120:28:101
746699110,1cyclictest0-21swapper/119:07:511
746699110,10cyclictest0-21swapper/120:08:241
746599119,1cyclictest0-21swapper/020:18:090
746599111,9cyclictest16086-21perl19:28:100
746899108,1cyclictest3342-21sh20:28:123
746899100,9cyclictest29813-21ntpq20:08:203
746899100,9cyclictest22797-21smartctl19:48:123
746899100,9cyclictest19423-21fw_forwarded_lo19:38:113
746899100,9cyclictest16841-21ntpq19:28:173
746899100,9cyclictest12856-21perl19:18:083
746899100,9cyclictest0-21swapper/320:18:103
746899100,9cyclictest0-21swapper/320:05:213
746899100,9cyclictest0-21swapper/320:00:153
746899100,9cyclictest0-21swapper/319:32:563
746899100,1cyclictest7077-21cut20:38:153
746799109,0cyclictest341ktimersoftd/219:48:112
746799101,2cyclictest111rcu_preempt20:42:172
746799101,0cyclictest341ktimersoftd/219:58:112
746799100,9cyclictest0-21swapper/220:44:322
746799100,9cyclictest0-21swapper/219:54:482
746799100,9cyclictest0-21swapper/219:28:092
746799100,1cyclictest32042-21diskstats20:18:092
746799100,1cyclictest0-21swapper/220:28:182
746799100,0cyclictest0-21swapper/220:35:472
746799100,0cyclictest0-21swapper/220:26:252
746799100,0cyclictest0-21swapper/220:17:202
746799100,0cyclictest0-21swapper/220:05:122
746699108,1cyclictest0-21swapper/119:28:121
746699100,9cyclictest0-21swapper/120:38:161
746699100,9cyclictest0-21swapper/119:48:151
746699100,9cyclictest0-21swapper/119:38:091
746699100,1cyclictest32307-21cut20:18:101
746699100,1cyclictest12853-21tune2fs19:18:081
746599108,1cyclictest3895-21ntp_states20:28:180
746599108,1cyclictest28817-21diskstats20:08:080
746599108,1cyclictest20064-21ntp_states19:38:160
746599100,9cyclictest25905-21perl19:58:110
746599100,1cyclictest8907-21hddtemp_smartct19:07:520
746599100,1cyclictest6467-21perl20:38:090
746599100,1cyclictest12620-21diskstats19:18:070
74689998,0cyclictest0-21swapper/320:35:343
74689998,0cyclictest0-21swapper/319:07:373
74689990,9cyclictest0-21swapper/320:48:103
74689990,0cyclictest0-21swapper/320:46:083
74679998,0cyclictest0-21swapper/219:06:072
74679990,0cyclictest0-21swapper/219:16:072
74679990,0cyclictest0-21swapper/219:16:072
74669998,0cyclictest0-21swapper/119:27:241
74659998,0cyclictest0-21swapper/019:44:040
74659998,0cyclictest0-21swapper/019:33:370
74689987,0cyclictest0-21swapper/320:14:323
74689987,0cyclictest0-21swapper/319:54:053
74689987,0cyclictest0-21swapper/319:46:183
74689987,0cyclictest0-21swapper/319:17:013
74689987,0cyclictest0-21swapper/319:17:013
74679988,0cyclictest0-21swapper/219:18:142
74679980,2cyclictest35-21ksoftirqd/219:33:022
74679980,2cyclictest121rcu_sched20:11:082
74679980,0cyclictest0-21swapper/219:44:282
74669987,0cyclictest0-21swapper/120:49:181
74659987,0cyclictest0-21swapper/020:54:080
74659987,0cyclictest0-21swapper/020:24:160
74659987,0cyclictest0-21swapper/020:13:280
74659987,0cyclictest0-21swapper/019:15:510
74659987,0cyclictest0-21swapper/019:15:510
74659980,4cyclictest24942-21perf19:57:500
74689976,0cyclictest0-21swapper/320:25:133
74689976,0cyclictest0-21swapper/319:27:153
74679970,0cyclictest121rcu_sched20:53:312
74679970,0cyclictest0-21swapper/219:26:032
74669977,0cyclictest0-21swapper/119:17:501
74669976,0cyclictest0-21swapper/119:03:551
74669970,6cyclictest0-21swapper/120:54:591
74669970,1cyclictest8318-21chrt20:43:361
74669970,1cyclictest5235-21sshd20:35:221
74669970,1cyclictest31365-21munin-plugin-st20:17:501
74669970,1cyclictest2274-21ls20:27:501
74669970,1cyclictest1882-21sendmail20:03:311
74659976,0cyclictest0-21swapper/020:42:590
74659976,0cyclictest0-21swapper/020:03:360
74659970,1cyclictest14929-21chrt19:24:590
74689964,1cyclictest116382sleep320:54:273
74669960,5cyclictest212712sleep119:43:121
74669960,0cyclictest0-21swapper/119:34:061
74669960,0cyclictest0-21swapper/119:13:171
74659960,5cyclictest0-21swapper/020:33:010
74659960,0cyclictest1022-21runrttasks19:05:030
74669950,0cyclictest0-21swapper/119:53:041
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional