You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-11 - 03:50

x86 Intel Atom E3845 @1910 MHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot1.osadl.org (updated Sun Jun 11, 2023 00:46:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1176911720,60ptp4l0-21swapper/019:09:470
1176911670,8ptp4l0-21swapper/219:05:092
1176911420,8ptp4l0-21swapper/319:08:433
2240621250,3sleep2702799cyclictest20:50:312
1176911230,9ptp4l0-21swapper/119:09:051
92732860,2sleep00-21swapper/020:23:340
7026997955,18cyclictest25-21ksoftirqd/123:15:231
117691760,2ptp4l0-21swapper/220:18:332
7026997560,9cyclictest25-21ksoftirqd/122:35:201
117691700,19ptp4l1185-21lldpd23:13:190
7026996954,8cyclictest25-21ksoftirqd/123:30:191
7026996953,7cyclictest25-21ksoftirqd/120:50:171
117691690,4ptp4l29681-21sed00:35:213
117691690,2ptp4l0-21swapper/320:43:583
117691690,2ptp4l0-21swapper/222:04:562
7026996853,8cyclictest25-21ksoftirqd/120:30:251
117691680,5ptp4l1185-21lldpd00:19:380
117691680,5ptp4l1185-21lldpd00:16:012
117691680,2ptp4l0-21swapper/223:26:252
7026996753,7cyclictest25-21ksoftirqd/121:50:221
165622670,5sleep01185-21lldpd00:05:430
117691670,5ptp4l22703-21open_inodes22:00:390
117691670,5ptp4l1185-21lldpd00:05:492
117691670,2ptp4l0-21swapper/222:28:072
117691670,10ptp4l1185-21lldpd23:57:410
7026996652,7cyclictest25-21ksoftirqd/100:30:191
7026996652,7cyclictest25-21ksoftirqd/100:30:191
7026996649,8cyclictest25-21ksoftirqd/122:10:151
7026996647,13cyclictest25-21ksoftirqd/120:10:171
117691660,5ptp4l1185-21lldpd22:56:212
117691660,5ptp4l1159-21snmpd00:30:032
117691660,5ptp4l1159-21snmpd00:30:032
117691660,2ptp4l0-21swapper/319:22:263
117691660,12ptp4l1142-21runrttasks22:58:181
7026996550,7cyclictest25-21ksoftirqd/122:45:211
7026996550,6cyclictest25-21ksoftirqd/120:40:191
210282650,3sleep20-21swapper/219:40:222
117691650,4ptp4l1185-21lldpd22:53:580
117691650,4ptp4l1185-21lldpd22:53:580
117691650,4ptp4l1185-21lldpd21:48:072
117691650,4ptp4l1159-21snmpd22:08:373
117691650,30ptp4l1185-21lldpd21:00:062
117691650,30ptp4l1185-21lldpd21:00:062
117691650,2ptp4l0-21swapper/221:14:322
117691650,2ptp4l0-21swapper/021:49:010
117691650,19ptp4l28975-21iostat21:05:280
117691640,6ptp4l1185-21lldpd22:14:472
117691640,6ptp4l1159-21snmpd19:51:323
117691640,5ptp4l1159-21snmpd21:15:262
117691640,5ptp4l1159-21snmpd20:40:222
117691640,4ptp4l1159-21snmpd21:55:582
117691640,4ptp4l1159-21snmpd21:55:582
117691640,2ptp4l0-21swapper/223:51:012
117691640,2ptp4l0-21swapper/223:10:382
239112630,5sleep31159-21snmpd19:45:253
117691630,5ptp4l1185-21lldpd22:43:072
117691630,5ptp4l1159-21snmpd23:31:130
117691630,5ptp4l1159-21snmpd22:38:433
117691630,5ptp4l1159-21snmpd19:26:043
117691630,4ptp4l1159-21snmpd23:23:060
117691630,4ptp4l1159-21snmpd23:06:150
117691630,3ptp4l0-21swapper/320:10:183
117691630,2ptp4l0-21swapper/220:33:522
117691630,2ptp4l0-21swapper/023:19:290
117691630,24ptp4l1185-21lldpd20:35:442
117691630,18ptp4l0-21swapper/220:23:582
117691630,15ptp4l0-21swapper/223:18:402
117691630,13ptp4l1159-21snmpd19:34:580
7026996252,5cyclictest25-21ksoftirqd/123:00:191
7026996246,6cyclictest25-21ksoftirqd/100:10:181
117691620,4ptp4l1185-21lldpd20:55:450
117691620,2ptp4l0-21swapper/323:10:413
117691620,2ptp4l0-21swapper/219:31:262
117691620,2ptp4l0-21swapper/123:55:101
117691620,21ptp4l0-21swapper/200:02:592
117691620,20ptp4l1185-21lldpd00:24:450
117691620,1ptp4l0-21swapper/222:22:432
7026996150,5cyclictest25-21ksoftirqd/120:20:191
117691610,5ptp4l1159-21snmpd00:21:152
117691610,4ptp4l1185-21lldpd23:29:263
117691610,4ptp4l1185-21lldpd21:02:460
117691610,4ptp4l1185-21lldpd21:02:450
117691610,4ptp4l1185-21lldpd19:24:162
117691610,4ptp4l1159-21snmpd00:15:103
117691610,3ptp4l216-21systemd-journal20:28:263
117691610,2ptp4l121rcu_preempt22:24:330
117691610,2ptp4l0-21swapper/322:17:243
117691610,2ptp4l0-21swapper/321:18:113
117691610,2ptp4l0-21swapper/221:28:112
117691610,2ptp4l0-21swapper/220:06:422
117691610,2ptp4l0-21swapper/220:06:422
117691610,2ptp4l0-21swapper/022:46:060
117691610,27ptp4l1185-21lldpd19:48:432
117691610,10ptp4l0-21swapper/020:43:330
117691600,9ptp4l0-21swapper/222:37:502
117691600,5ptp4l1185-21lldpd00:12:442
117691600,5ptp4l1159-21snmpd20:49:252
117691600,4ptp4l1185-21lldpd19:52:270
117691600,4ptp4l1185-21lldpd00:11:073
117691600,4ptp4l1159-21snmpd22:30:471
117691600,4ptp4l1159-21snmpd19:47:580
117691600,3ptp4l1159-21snmpd22:32:323
117691600,2ptp4l0-21swapper/323:02:453
117691600,2ptp4l0-21swapper/322:27:163
117691600,2ptp4l0-21swapper/321:37:083
117691600,2ptp4l0-21swapper/320:32:023
117691600,2ptp4l0-21swapper/022:29:570
117691600,1ptp4l0-21swapper/322:59:553
117691600,16ptp4l0-21swapper/223:04:312
117691590,6ptp4l1142-21runrttasks22:40:241
117691590,5ptp4l1185-21lldpd23:53:210
117691590,5ptp4l1185-21lldpd21:53:262
117691590,5ptp4l1185-21lldpd21:50:410
117691590,5ptp4l1185-21lldpd19:14:200
117691590,5ptp4l1159-21snmpd22:45:412
117691590,4ptp4l7024-21cyclictest19:43:213
117691590,3ptp4l1159-21snmpd00:27:372
117691590,2ptp4l0-21swapper/321:06:013
117691590,2ptp4l0-21swapper/222:52:512
117691590,2ptp4l0-21swapper/222:52:512
117691590,2ptp4l0-21swapper/219:16:562
117691590,2ptp4l0-21swapper/123:40:241
117691590,2ptp4l0-21swapper/123:40:241
117691590,2ptp4l0-21swapper/119:15:081
117691590,1ptp4l0-21swapper/322:24:293
117691590,1ptp4l0-21swapper/321:46:173
117691590,16ptp4l0-21swapper/020:29:560
7028995816,4cyclictest41-21ksoftirqd/320:00:353
117691580,4ptp4l216-21systemd-journal22:09:302
117691580,3ptp4l1159-21snmpd20:03:041
117691580,2ptp4l0-21swapper/322:41:193
117691580,2ptp4l0-21swapper/320:59:123
117691580,2ptp4l0-21swapper/219:56:482
117691580,2ptp4l0-21swapper/121:20:451
117691580,1ptp4l0-21swapper/321:57:573
117691580,1ptp4l0-21swapper/321:57:563
117691580,1ptp4l0-21swapper/219:28:412
117691570,7ptp4l9-21ksoftirqd/021:23:280
117691570,4ptp4l1185-21lldpd22:06:471
117691570,4ptp4l1185-21lldpd20:04:022
117691570,4ptp4l1159-21snmpd23:53:501
117691570,4ptp4l1159-21snmpd23:50:093
117691570,4ptp4l1159-21snmpd23:15:583
117691570,3ptp4l216-21systemd-journal20:12:100
117691570,3ptp4l19366-21gzip00:12:460
117691570,3ptp4l1185-21lldpd21:18:590
117691570,3ptp4l1185-21lldpd20:35:250
117691570,3ptp4l1185-21lldpd19:15:140
117691570,2ptp4l0-21swapper/321:40:293
117691570,2ptp4l0-21swapper/321:11:273
117691570,2ptp4l0-21swapper/221:07:492
117691570,2ptp4l0-21swapper/022:12:030
117691570,2ptp4l0-21swapper/022:05:380
117691570,2ptp4l0-21swapper/020:15:210
117691570,18ptp4l1159-21snmpd20:07:420
117691570,18ptp4l1159-21snmpd20:07:420
117691570,12ptp4l0-21swapper/020:33:380
7026995648,4cyclictest25-21ksoftirqd/100:25:161
7026995646,6cyclictest25-21ksoftirqd/123:25:201
117691560,9ptp4l9-21ksoftirqd/022:56:380
117691560,6ptp4l1159-21snmpd23:47:393
117691560,4ptp4l1185-21lldpd22:40:070
117691560,4ptp4l1185-21lldpd21:36:112
117691560,3ptp4l1159-21snmpd20:15:023
117691560,2ptp4l0-21swapper/323:35:223
117691560,2ptp4l0-21swapper/322:13:523
117691560,2ptp4l0-21swapper/319:55:323
117691560,2ptp4l0-21swapper/319:11:293
117691560,2ptp4l0-21swapper/223:56:332
117691560,2ptp4l0-21swapper/221:43:382
117691560,2ptp4l0-21swapper/200:38:332
117691560,2ptp4l0-21swapper/100:15:091
117691560,2ptp4l0-21swapper/023:39:090
117691560,2ptp4l0-21swapper/023:25:380
117691560,2ptp4l0-21swapper/000:28:190
117691560,20ptp4l9-21ksoftirqd/021:31:420
117691560,17ptp4l1159-21snmpd19:36:321
117691550,6ptp4l1185-21lldpd20:19:151
117691550,4ptp4l1185-21lldpd21:13:590
117691550,2ptp4l0-21swapper/322:49:443
117691550,2ptp4l0-21swapper/319:33:103
117691550,2ptp4l0-21swapper/300:29:013
117691550,2ptp4l0-21swapper/023:49:450
117691550,2ptp4l0-21swapper/022:37:480
117691550,2ptp4l0-21swapper/020:50:370
117691550,1ptp4l0-21swapper/319:39:143
117691550,1ptp4l0-21swapper/000:39:190
117691540,5ptp4l1159-21snmpd22:30:272
117691540,3ptp4l1159-21snmpd23:44:533
117691540,3ptp4l1159-21snmpd23:44:523
117691540,2ptp4l0-21swapper/323:09:513
117691540,2ptp4l0-21swapper/322:00:303
117691540,2ptp4l0-21swapper/300:34:473
117691540,2ptp4l0-21swapper/300:34:473
117691540,2ptp4l0-21swapper/223:42:442
117691540,2ptp4l0-21swapper/223:42:442
117691540,2ptp4l0-21swapper/023:42:120
117691540,2ptp4l0-21swapper/023:42:120
117691540,2ptp4l0-21swapper/022:33:350
117691540,2ptp4l0-21swapper/020:45:210
117691540,2ptp4l0-21swapper/019:55:060
117691540,2ptp4l0-21swapper/000:31:490
117691540,2ptp4l0-21swapper/000:31:480
117691530,4ptp4l1159-21snmpd20:39:101
117691530,4ptp4l1159-21snmpd19:57:371
117691530,2ptp4l0-21swapper/319:16:583
117691530,2ptp4l0-21swapper/300:21:233
117691530,2ptp4l0-21swapper/300:02:103
117691530,2ptp4l0-21swapper/223:07:512
117691530,2ptp4l0-21swapper/219:38:172
117691530,2ptp4l0-21swapper/123:09:031
117691530,2ptp4l0-21swapper/119:40:371
117691530,2ptp4l0-21swapper/023:02:360
117691530,2ptp4l0-21swapper/020:02:310
117791520,13getstats1185-21lldpd21:42:520
117691520,3ptp4l1185-21lldpd23:20:263
117691520,2ptp4l0-21swapper/323:33:183
117691520,2ptp4l0-21swapper/300:07:023
117691520,2ptp4l0-21swapper/220:11:282
117691520,2ptp4l0-21swapper/121:25:321
117691520,2ptp4l0-21swapper/120:47:261
117691520,2ptp4l0-21swapper/119:10:291
117691520,13ptp4l0-21swapper/223:49:152
117691510,4ptp4l1185-21lldpd21:20:172
117691510,4ptp4l1185-21lldpd19:45:331
117691510,4ptp4l1185-21lldpd00:01:581
117691510,4ptp4l1159-21snmpd19:23:510
117691510,2ptp4l0-21swapper/321:23:513
117691510,2ptp4l0-21swapper/321:04:493
117691510,2ptp4l0-21swapper/321:04:483
117691510,2ptp4l0-21swapper/320:24:093
117691510,2ptp4l0-21swapper/123:37:211
117691510,2ptp4l0-21swapper/123:12:231
117691510,2ptp4l0-21swapper/121:14:441
117691510,2ptp4l0-21swapper/120:07:201
117691510,2ptp4l0-21swapper/120:07:201
117791500,10getstats0-21swapper/021:39:520
117691500,5ptp4l1159-21snmpd21:35:371
117691500,3ptp4l1185-21lldpd22:02:171
117691500,2ptp4l0-21swapper/321:32:053
117691500,2ptp4l0-21swapper/321:28:573
117691500,2ptp4l0-21swapper/320:52:063
117691500,2ptp4l0-21swapper/123:22:441
117691500,2ptp4l0-21swapper/121:15:461
117691500,2ptp4l0-21swapper/121:04:111
117691500,2ptp4l0-21swapper/121:04:101
117691500,2ptp4l0-21swapper/100:36:271
117691500,2ptp4l0-21swapper/100:20:531
117691500,1ptp4l0-21swapper/322:50:183
117691500,1ptp4l0-21swapper/322:50:183
117691500,1ptp4l0-21swapper/320:48:473
117691490,5ptp4l1159-21snmpd23:39:582
117791480,9getstats0-21swapper/021:55:010
117791480,9getstats0-21swapper/021:55:010
117691480,2ptp4l0-21swapper/222:15:252
117691480,1ptp4l0-21swapper/122:52:241
117691480,1ptp4l0-21swapper/122:52:231
117691480,14ptp4l1185-21lldpd21:44:151
117691480,12ptp4l1185-21lldpd00:04:350
117691470,2ptp4l0-21swapper/223:21:542
117691470,13ptp4l1159-21snmpd19:24:121
117691470,12ptp4l0-21swapper/320:08:373
117691470,12ptp4l0-21swapper/320:08:373
117691470,11ptp4l0-21swapper/022:17:190
117691470,10ptp4l0-21swapper/122:20:371
117691460,4ptp4l216-21systemd-journal23:34:472
117691460,1ptp4l0-21swapper/121:33:021
117691460,13ptp4l4815-21rs:main1
117691460,12ptp4l1185-21lldpd19:42:200
117691450,6ptp4l1185-21lldpd19:53:352
117691450,2ptp4l0-21swapper/323:58:183
117691450,11ptp4l0-21swapper/119:33:041
117691440,9ptp4l0-21swapper/021:29:310
117691440,6ptp4l1185-21lldpd21:34:252
117691440,11ptp4l0-21swapper/120:56:301
117691430,6ptp4l0-21swapper/220:25:162
117691430,5ptp4l1185-21lldpd22:18:031
117691430,4ptp4l1185-21lldpd19:12:262
117691430,2ptp4l0-21swapper/122:28:071
7028994222,4cyclictest41-21ksoftirqd/320:35:223
117691420,7ptp4l1159-21snmpd00:05:361
117691420,6ptp4l1185-21lldpd19:39:430
117691420,5ptp4l1185-21lldpd21:50:213
702799410,5cyclictest24561-21/usr/sbin/munin20:55:302
117691410,8ptp4l1185-21lldpd20:25:541
117691410,6ptp4l1185-21lldpd23:45:011
117691410,6ptp4l1159-21snmpd21:55:351
117691410,6ptp4l1159-21snmpd21:55:351
117691410,4ptp4l1185-21lldpd21:45:571
117691400,5ptp4l1185-21lldpd19:25:290
117691390,5ptp4l1159-21snmpd21:06:541
117691390,4ptp4l1185-21lldpd19:25:301
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional