You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-31 - 11:25

x86 Intel Atom E3845 @1910 MHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the alll highest latencies:
System rackdslot1.osadl.org (updated Fri Mar 31, 2023 00:46:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
402823630,9sleep24030-21irqrtprio19:05:232
2975121690,8sleep0553699cyclictest20:05:010
1176911610,14ptp4l0-21swapper/319:07:143
1176911520,8ptp4l0-21swapper/019:06:280
1176911410,15ptp4l0-21swapper/119:08:261
117691750,2ptp4l0-21swapper/123:10:151
5537997259,7cyclictest25-21ksoftirqd/123:40:161
117691720,2ptp4l0-21swapper/121:36:571
5537997156,8cyclictest25-21ksoftirqd/120:55:121
5537997056,7cyclictest25-21ksoftirqd/121:20:141
112102700,7sleep2553899cyclictest00:10:292
117691670,8ptp4l0-21swapper/200:36:412
117691660,4ptp4l11854-21chrt00:12:140
5537996551,7cyclictest25-21ksoftirqd/123:50:141
154022650,5sleep115406-21fschecks_time00:20:271
145672650,5sleep014572-21irqrtprio20:40:210
117691650,1ptp4l0-21swapper/223:04:472
5537996452,6cyclictest25-21ksoftirqd/122:55:121
230602620,1sleep00-21swapper/000:35:400
117691620,4ptp4l21738-21memory20:55:230
117691620,3ptp4l33-21ksoftirqd/222:13:352
117691620,2ptp4l0-21swapper/222:00:382
220502610,2sleep20-21swapper/219:45:162
154272610,4sleep05535-21cyclictest21:55:210
117691610,2ptp4l0-21swapper/221:33:492
117691610,2ptp4l0-21swapper/221:33:492
117691610,2ptp4l0-21swapper/220:10:202
117691610,2ptp4l0-21swapper/220:10:202
117691610,2ptp4l0-21swapper/219:39:442
117691610,2ptp4l0-21swapper/019:15:210
5539995945,6cyclictest41-21ksoftirqd/319:20:253
5537995946,7cyclictest25-21ksoftirqd/100:15:191
117691590,2ptp4l0-21swapper/221:47:552
117691590,2ptp4l0-21swapper/221:35:532
117691580,2ptp4l0-21swapper/320:04:173
117691580,2ptp4l0-21swapper/320:04:163
117691580,2ptp4l0-21swapper/221:25:302
117691580,2ptp4l0-21swapper/200:06:312
5539995743,6cyclictest41-21ksoftirqd/300:25:123
5537995744,7cyclictest25-21ksoftirqd/120:05:131
147022570,3sleep30-21swapper/300:20:003
117791570,12getstats0-21swapper/021:45:140
117691570,2ptp4l0-21swapper/322:35:363
117691570,1ptp4l0-21swapper/119:10:191
5537995644,7cyclictest25-21ksoftirqd/121:00:251
117691560,2ptp4l0-21swapper/221:54:302
117691560,2ptp4l0-21swapper/221:03:012
117691560,2ptp4l0-21swapper/220:45:002
117691560,2ptp4l0-21swapper/220:22:072
117691560,2ptp4l0-21swapper/220:03:112
117691560,2ptp4l0-21swapper/220:03:102
117691560,2ptp4l0-21swapper/200:34:372
117691560,2ptp4l0-21swapper/019:52:450
117691560,1ptp4l0-21swapper/223:14:232
117691560,1ptp4l0-21swapper/019:58:240
5537995543,6cyclictest25-21ksoftirqd/100:05:181
117691550,2ptp4l0-21swapper/323:39:143
117691550,2ptp4l0-21swapper/220:29:432
117691550,2ptp4l0-21swapper/120:23:331
117691550,2ptp4l0-21swapper/021:15:210
117691550,2ptp4l0-21swapper/020:52:450
117691550,1ptp4l0-21swapper/000:01:010
117691550,1ptp4l0-21swapper/000:01:000
117691550,14ptp4l0-21swapper/323:05:273
5537995442,6cyclictest25-21ksoftirqd/123:20:131
268512540,2sleep30-21swapper/321:05:303
117691540,9ptp4l0-21swapper/323:00:033
117691540,8ptp4l0-21swapper/022:57:060
117691540,2ptp4l0-21swapper/222:06:472
117691540,2ptp4l0-21swapper/220:57:542
117691540,2ptp4l0-21swapper/219:50:422
117691540,2ptp4l0-21swapper/022:00:290
117691540,1ptp4l0-21swapper/222:50:172
117691540,1ptp4l0-21swapper/222:50:162
117691530,2ptp4l0-21swapper/322:25:363
117691530,2ptp4l0-21swapper/223:40:192
117691530,2ptp4l0-21swapper/021:35:180
117691530,1ptp4l0-21swapper/221:09:252
117791520,14getstats23531-21users22:10:380
117691520,3ptp4l1142-21runrttasks00:31:380
117691520,2ptp4l0-21swapper/322:22:233
117691520,2ptp4l0-21swapper/219:56:002
117691520,2ptp4l0-21swapper/200:27:462
117691520,2ptp4l0-21swapper/122:12:161
117691520,1ptp4l0-21swapper/223:20:402
117691520,10ptp4l0-21swapper/320:55:193
117791510,13getstats28671-21diskstats23:40:210
117691510,2ptp4l0-21swapper/323:11:353
117691510,2ptp4l0-21swapper/221:16:342
117691510,2ptp4l0-21swapper/221:10:442
117691510,2ptp4l0-21swapper/022:15:300
117691510,2ptp4l0-21swapper/021:08:100
117691510,1ptp4l0-21swapper/323:20:193
117691510,1ptp4l0-21swapper/223:45:302
117691510,1ptp4l0-21swapper/221:58:112
117691510,1ptp4l0-21swapper/219:30:272
117691510,12ptp4l0-21swapper/222:25:432
117691500,9ptp4l0-21swapper/100:38:021
117691500,2ptp4l0-21swapper/322:42:163
117691500,2ptp4l0-21swapper/119:31:541
117691500,2ptp4l0-21swapper/000:20:090
117691500,1ptp4l0-21swapper/019:39:050
117691490,2ptp4l0-21swapper/323:44:213
117691490,2ptp4l0-21swapper/323:18:363
117691490,2ptp4l0-21swapper/120:45:341
117691490,2ptp4l0-21swapper/120:19:291
117691490,2ptp4l0-21swapper/119:41:131
117691490,2ptp4l0-21swapper/100:00:171
117691490,2ptp4l0-21swapper/100:00:171
117691490,2ptp4l0-21swapper/020:11:340
117691490,2ptp4l0-21swapper/020:11:340
117691490,1ptp4l0-21swapper/222:22:192
117691490,1ptp4l0-21swapper/222:19:202
117691490,1ptp4l0-21swapper/219:44:412
117691490,1ptp4l0-21swapper/121:43:351
117691490,1ptp4l0-21swapper/119:17:131
117691490,1ptp4l0-21swapper/021:43:160
117691490,1ptp4l0-21swapper/021:02:470
117691490,1ptp4l0-21swapper/019:25:540
117691490,1ptp4l0-21swapper/019:22:320
117691490,13ptp4l0-21swapper/021:14:110
117691490,10ptp4l0-21swapper/222:56:102
117791480,9getstats0-21swapper/023:51:350
117791480,9getstats0-21swapper/023:24:080
117791480,9getstats0-21swapper/021:34:240
117791480,9getstats0-21swapper/021:34:230
117691480,2ptp4l0-21swapper/322:31:483
117691480,2ptp4l0-21swapper/319:39:563
117691480,2ptp4l0-21swapper/223:38:272
117691480,2ptp4l0-21swapper/222:39:192
117691480,2ptp4l0-21swapper/019:41:000
117691480,1ptp4l0-21swapper/223:17:352
117691480,1ptp4l0-21swapper/122:32:411
117691480,1ptp4l0-21swapper/120:25:071
117691480,1ptp4l0-21swapper/119:38:511
117791470,9getstats0-21swapper/023:05:570
117791470,9getstats0-21swapper/022:34:200
117791470,9getstats0-21swapper/000:05:030
117691470,8ptp4l0-21swapper/219:20:052
117691470,2ptp4l0-21swapper/322:53:423
117691470,2ptp4l0-21swapper/322:53:423
117691470,2ptp4l0-21swapper/121:07:461
117691470,2ptp4l0-21swapper/120:04:001
117691470,2ptp4l0-21swapper/120:04:001
117691470,2ptp4l0-21swapper/023:59:100
117691470,2ptp4l0-21swapper/021:53:370
117691470,1ptp4l0-21swapper/321:58:133
117691470,1ptp4l0-21swapper/120:30:431
117691470,1ptp4l0-21swapper/023:49:160
117691470,1ptp4l0-21swapper/020:19:050
117691470,11ptp4l0-21swapper/220:05:282
5537994618,4cyclictest25-21ksoftirqd/123:55:341
117791460,9getstats0-21swapper/019:13:210
117791460,8getstats0-21swapper/319:52:403
117791460,8getstats0-21swapper/023:12:100
117691460,8ptp4l0-21swapper/220:48:372
117691460,8ptp4l0-21swapper/220:33:442
117691460,8ptp4l0-21swapper/023:03:210
117691460,8ptp4l0-21swapper/022:53:080
117691460,8ptp4l0-21swapper/022:53:070
117691460,8ptp4l0-21swapper/022:25:460
117691460,2ptp4l0-21swapper/323:45:133
117691460,2ptp4l0-21swapper/319:57:023
117691460,2ptp4l0-21swapper/223:29:102
117691460,2ptp4l0-21swapper/223:09:452
117691460,2ptp4l0-21swapper/222:41:292
117691460,2ptp4l0-21swapper/221:40:592
117691460,2ptp4l0-21swapper/100:31:371
117691460,1ptp4l0-21swapper/119:27:121
5537994518,4cyclictest25-21ksoftirqd/121:55:241
117791450,9getstats0-21swapper/023:38:540
117691450,9ptp4l0-21swapper/223:55:302
117691450,8ptp4l0-21swapper/220:38:022
117691450,8ptp4l0-21swapper/219:16:302
117691450,8ptp4l0-21swapper/200:04:142
117691450,8ptp4l0-21swapper/200:04:132
117691450,8ptp4l0-21swapper/022:47:260
117691450,4ptp4l21635-21df_inode23:25:200
117691450,2ptp4l0-21swapper/323:25:263
117691450,2ptp4l0-21swapper/320:09:443
117691450,2ptp4l0-21swapper/119:45:061
117691450,2ptp4l0-21swapper/020:34:390
117691450,1ptp4l0-21swapper/322:45:543
117691450,1ptp4l0-21swapper/319:43:273
117691450,1ptp4l0-21swapper/219:13:472
117691450,1ptp4l0-21swapper/122:35:391
117691450,1ptp4l0-21swapper/121:45:351
117691450,1ptp4l0-21swapper/119:54:331
117691450,1ptp4l0-21swapper/022:40:220
117691450,1ptp4l0-21swapper/022:07:050
117691450,10ptp4l0-21swapper/022:35:340
117791440,8getstats0-21swapper/019:49:220
117691440,8ptp4l0-21swapper/200:21:412
117691440,3ptp4l2626-21runrttasks21:28:031
117691440,2ptp4l0-21swapper/322:57:143
117691440,2ptp4l0-21swapper/223:30:052
117691440,2ptp4l0-21swapper/119:56:481
117691440,2ptp4l0-21swapper/119:24:181
117691440,2ptp4l0-21swapper/021:22:400
117691440,2ptp4l0-21swapper/020:01:030
117691440,2ptp4l0-21swapper/020:01:020
117691440,2ptp4l0-21swapper/000:15:590
5539994330,6cyclictest41-21ksoftirqd/319:10:133
117691430,8ptp4l0-21swapper/122:06:301
117691430,8ptp4l0-21swapper/023:30:190
117691430,2ptp4l0-21swapper/323:31:363
117691430,2ptp4l0-21swapper/222:32:132
117691430,2ptp4l0-21swapper/200:15:232
117691430,2ptp4l0-21swapper/122:00:121
117691430,1ptp4l0-21swapper/322:18:533
117691430,1ptp4l0-21swapper/120:53:121
117691430,1ptp4l0-21swapper/020:36:060
117691430,11ptp4l0-21swapper/120:44:581
117691430,10ptp4l0-21swapper/100:25:111
5537994214,8cyclictest25-21ksoftirqd/120:35:181
117691420,2ptp4l0-21swapper/320:40:003
117691420,2ptp4l0-21swapper/222:47:572
117691420,2ptp4l0-21swapper/123:47:491
117691420,2ptp4l0-21swapper/121:15:021
117691420,2ptp4l0-21swapper/021:29:410
117691420,1ptp4l0-21swapper/220:53:022
117691420,1ptp4l0-21swapper/122:43:151
117691410,5ptp4l32663-21diskstats20:10:171
117691410,5ptp4l32663-21diskstats20:10:171
117691410,4ptp4l26606-21apt-get22:20:141
117691410,4ptp4l1575-21ntp_states23:50:263
117691410,2ptp4l0-21swapper/223:51:072
117691410,2ptp4l0-21swapper/221:21:212
117691410,2ptp4l0-21swapper/220:15:562
117691410,2ptp4l0-21swapper/219:25:162
117691410,2ptp4l0-21swapper/022:20:030
117691410,2ptp4l0-21swapper/020:22:170
5537994011,8cyclictest25-21ksoftirqd/122:50:311
5537994011,8cyclictest25-21ksoftirqd/122:50:301
117691400,4ptp4l4582-21apt-get20:20:133
117691400,4ptp4l20653-21ntp_states22:05:273
117691400,4ptp4l18384-21grep20:50:010
117691400,4ptp4l17632-21df_inode00:25:160
117691400,4ptp4l16047-21memory19:30:230
117691400,3ptp4l3100-21apt-get21:30:221
117691400,3ptp4l3100-21apt-get21:30:211
117691400,2ptp4l0-21swapper/122:29:571
117691400,2ptp4l0-21swapper/023:18:500
117691400,10ptp4l0-21swapper/123:05:551
5539993927,6cyclictest41-21ksoftirqd/300:35:213
5537993911,5cyclictest25-21ksoftirqd/121:50:211
5537993910,4cyclictest25-21ksoftirqd/123:35:251
117691390,4ptp4l9059-21/usr/sbin/munin21:40:293
117691390,4ptp4l24139-21if_enp1s023:30:211
117691390,2ptp4l0-21swapper/321:50:093
117691390,2ptp4l0-21swapper/320:55:013
117691390,2ptp4l0-21swapper/320:45:013
117691390,2ptp4l0-21swapper/122:15:341
117691390,2ptp4l0-21swapper/020:25:360
553799380,4cyclictest121rcu_preempt23:15:261
117691380,4ptp4l10173-21grep21:45:153
117691380,2ptp4l0-21swapper/322:00:183
117691380,2ptp4l0-21swapper/321:35:233
117691380,2ptp4l0-21swapper/320:48:563
117691380,2ptp4l0-21swapper/319:45:373
117691380,2ptp4l0-21swapper/319:25:223
117691380,2ptp4l0-21swapper/300:30:373
117691380,2ptp4l0-21swapper/123:00:391
5539993725,5cyclictest41-21ksoftirqd/300:10:123
117691370,2ptp4l0-21swapper/322:14:193
117691370,2ptp4l0-21swapper/321:25:193
117691370,2ptp4l0-21swapper/321:14:043
117691370,2ptp4l0-21swapper/321:00:193
117691370,2ptp4l0-21swapper/320:32:223
117691370,2ptp4l0-21swapper/320:26:153
117691370,2ptp4l0-21swapper/320:18:173
117691370,2ptp4l0-21swapper/320:12:103
117691370,2ptp4l0-21swapper/320:12:103
117691370,2ptp4l0-21swapper/319:30:253
117691370,2ptp4l0-21swapper/123:25:201
117691370,2ptp4l0-21swapper/122:47:341
117691370,2ptp4l0-21swapper/121:11:181
117691370,2ptp4l0-21swapper/100:11:471
117691360,2ptp4l0-21swapper/323:59:553
117691360,2ptp4l0-21swapper/321:30:443
117691360,2ptp4l0-21swapper/321:30:433
117691360,2ptp4l0-21swapper/321:22:103
117691360,2ptp4l0-21swapper/321:16:583
117691360,2ptp4l0-21swapper/300:06:323
117691350,2ptp4l0-21swapper/319:15:073
117691350,2ptp4l0-21swapper/300:22:573
553999322,4cyclictest121rcu_preempt00:00:353
553999322,4cyclictest121rcu_preempt00:00:343
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional