You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-22 - 03:33

x86 Intel Atom E3845 @1910 MHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot1.osadl.org (updated Wed Mar 22, 2023 00:46:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1337921690,9sleep0136799cyclictest23:00:240
1176911680,16ptp4l0-21swapper/019:09:590
1176911680,14ptp4l0-21swapper/219:06:412
1176911570,15ptp4l0-21swapper/119:08:191
1176911410,13ptp4l0-21swapper/319:06:033
61692710,9sleep1136899cyclictest23:55:161
1368996528,6cyclictest25-21ksoftirqd/120:00:141
117691650,2ptp4l0-21swapper/222:30:332
1370996328,4cyclictest41-21ksoftirqd/322:55:203
117691630,2ptp4l0-21swapper/223:13:322
117691610,4ptp4l26829-21ls22:20:332
1370996019,5cyclictest41-21ksoftirqd/320:40:313
117691600,2ptp4l0-21swapper/022:40:550
1368995928,5cyclictest25-21ksoftirqd/100:10:251
1368995927,10cyclictest25-21ksoftirqd/119:10:151
1367995929,8cyclictest9-21ksoftirqd/000:15:290
117691590,2ptp4l0-21swapper/321:35:313
117691590,2ptp4l0-21swapper/223:00:012
1368995828,10cyclictest25-21ksoftirqd/100:35:171
1368995827,9cyclictest25-21ksoftirqd/119:35:161
1368995827,9cyclictest25-21ksoftirqd/119:35:151
1368995827,10cyclictest25-21ksoftirqd/120:45:151
1368995827,10cyclictest25-21ksoftirqd/100:20:231
117691580,1ptp4l0-21swapper/000:38:290
1370995746,7cyclictest41-21ksoftirqd/320:05:163
1367995727,8cyclictest9-21ksoftirqd/022:30:340
117691570,5ptp4l4914-21cpuspeed_turbos21:35:162
117691570,2ptp4l0-21swapper/320:00:193
117691570,2ptp4l0-21swapper/220:45:252
1370995647,5cyclictest41-21ksoftirqd/320:20:183
1370995645,7cyclictest41-21ksoftirqd/322:00:203
1370995621,5cyclictest41-21ksoftirqd/319:50:323
1367995629,4cyclictest9-21ksoftirqd/023:35:220
117691560,4ptp4l14223-21apt-get21:55:160
117691560,2ptp4l0-21swapper/320:26:143
117691560,2ptp4l0-21swapper/220:57:082
117691560,1ptp4l0-21swapper/319:47:513
1370995544,8cyclictest41-21ksoftirqd/322:25:213
1370995543,8cyclictest41-21ksoftirqd/321:20:203
1368995526,11cyclictest25-21ksoftirqd/100:05:311
1368995526,10cyclictest25-21ksoftirqd/122:15:351
1368995526,10cyclictest25-21ksoftirqd/121:25:301
117691550,2ptp4l0-21swapper/223:55:122
117691550,2ptp4l0-21swapper/223:35:232
117691550,2ptp4l0-21swapper/222:39:532
117691550,1ptp4l0-21swapper/320:33:003
117691550,1ptp4l0-21swapper/319:30:543
117691550,1ptp4l0-21swapper/219:19:392
1370995444,6cyclictest41-21ksoftirqd/323:55:163
1370995431,4cyclictest41-21ksoftirqd/319:10:193
1368995424,11cyclictest25-21ksoftirqd/100:30:231
1368995424,10cyclictest25-21ksoftirqd/123:20:291
1367995426,10cyclictest9-21ksoftirqd/000:05:290
1367995424,11cyclictest9-21ksoftirqd/020:20:250
117691540,2ptp4l0-21swapper/220:50:322
117691540,1ptp4l0-21swapper/023:50:360
1370995323,5cyclictest41-21ksoftirqd/322:45:003
1367995339,3cyclictest9-21ksoftirqd/023:15:160
1367995312,4cyclictest9-21ksoftirqd/022:25:440
117691530,2ptp4l0-21swapper/320:55:213
117691530,2ptp4l0-21swapper/222:56:312
117691530,2ptp4l0-21swapper/220:18:352
1370995220,9cyclictest41-21ksoftirqd/323:41:153
136899524,7cyclictest25-21ksoftirqd/119:15:261
1368995225,7cyclictest25-21ksoftirqd/123:05:321
136899521,8cyclictest241ktimersoftd/119:20:201
117691520,8ptp4l0-21swapper/122:50:391
117691520,2ptp4l0-21swapper/322:15:373
117691520,2ptp4l0-21swapper/319:35:233
117691520,2ptp4l0-21swapper/319:35:233
117691520,2ptp4l0-21swapper/223:32:312
117691520,2ptp4l0-21swapper/223:32:312
117691520,2ptp4l0-21swapper/223:25:372
117691520,2ptp4l0-21swapper/221:30:162
117691520,2ptp4l0-21swapper/221:20:232
117691520,2ptp4l0-21swapper/120:40:151
117691520,2ptp4l0-21swapper/023:58:440
117691520,1ptp4l0-21swapper/222:53:522
1370995118,5cyclictest41-21ksoftirqd/300:35:003
136899511,8cyclictest241ktimersoftd/123:30:311
136899511,8cyclictest241ktimersoftd/123:30:301
136899511,8cyclictest241ktimersoftd/123:10:351
136899511,8cyclictest241ktimersoftd/119:25:181
136799517,7cyclictest9-21ksoftirqd/023:05:170
1367995119,7cyclictest9-21ksoftirqd/023:20:230
1367995112,7cyclictest9-21ksoftirqd/021:45:210
117691510,2ptp4l0-21swapper/323:35:323
117691510,2ptp4l0-21swapper/323:06:153
117691510,2ptp4l0-21swapper/300:25:353
117691510,2ptp4l0-21swapper/222:13:512
117691510,2ptp4l0-21swapper/222:13:512
117691510,2ptp4l0-21swapper/221:25:212
117691510,2ptp4l0-21swapper/220:20:242
117691510,2ptp4l0-21swapper/220:00:142
117691510,2ptp4l0-21swapper/219:12:182
117691510,2ptp4l0-21swapper/121:20:261
137099501,8cyclictest1159-21snmpd19:20:193
136899504,7cyclictest241ktimersoftd/100:25:281
136899501,8cyclictest241ktimersoftd/122:10:301
136899501,8cyclictest241ktimersoftd/122:10:291
136899500,46cyclictest241ktimersoftd/123:50:261
1367995031,8cyclictest9-21ksoftirqd/021:25:200
1367995029,10cyclictest9-21ksoftirqd/021:20:000
1367995027,8cyclictest9-21ksoftirqd/019:50:130
1367995011,4cyclictest9-21ksoftirqd/023:10:170
117691500,8ptp4l0-21swapper/122:26:461
117691500,2ptp4l0-21swapper/323:16:003
117691500,2ptp4l0-21swapper/320:35:073
117691500,2ptp4l0-21swapper/319:59:303
117691500,2ptp4l0-21swapper/223:20:212
117691500,2ptp4l0-21swapper/222:15:392
117691500,2ptp4l0-21swapper/221:55:352
117691500,2ptp4l0-21swapper/221:46:572
117691500,2ptp4l0-21swapper/219:48:172
117691500,2ptp4l0-21swapper/219:34:172
117691500,1ptp4l0-21swapper/322:31:003
117691500,1ptp4l0-21swapper/321:57:363
117691500,1ptp4l0-21swapper/220:12:412
137099491,8cyclictest13397-21sshd21:51:123
1370994917,5cyclictest41-21ksoftirqd/321:30:443
1368994930,8cyclictest25-21ksoftirqd/119:30:191
136899491,8cyclictest11993-21grep21:50:211
136899490,8cyclictest241ktimersoftd/121:05:311
136899490,46cyclictest241ktimersoftd/121:10:291
136799494,7cyclictest9-21ksoftirqd/020:35:140
1367994931,5cyclictest9-21ksoftirqd/000:30:210
1367994920,5cyclictest9-21ksoftirqd/022:55:210
1367994919,7cyclictest9-21ksoftirqd/000:10:020
117691490,2ptp4l0-21swapper/323:21:143
117691490,2ptp4l0-21swapper/322:54:023
117691490,2ptp4l0-21swapper/321:25:013
117691490,2ptp4l0-21swapper/320:53:113
117691490,2ptp4l0-21swapper/300:12:003
117691490,2ptp4l0-21swapper/223:07:332
117691490,2ptp4l0-21swapper/222:09:042
117691490,2ptp4l0-21swapper/221:08:502
117691490,2ptp4l0-21swapper/220:07:142
117691490,2ptp4l0-21swapper/123:35:091
117691490,2ptp4l0-21swapper/020:02:160
117691490,1ptp4l0-21swapper/323:13:023
117691490,1ptp4l0-21swapper/223:15:242
117691490,1ptp4l0-21swapper/222:25:262
117691490,1ptp4l0-21swapper/221:02:012
117691490,1ptp4l0-21swapper/220:30:262
117691490,1ptp4l0-21swapper/219:58:342
117691490,1ptp4l0-21swapper/123:43:321
117691490,1ptp4l0-21swapper/100:00:151
117691490,11ptp4l0-21swapper/021:35:440
137099483,4cyclictest121rcu_preempt21:40:273
1370994829,7cyclictest41-21ksoftirqd/300:05:263
1370994822,9cyclictest41-21ksoftirqd/322:35:313
136899484,8cyclictest25-21ksoftirqd/123:00:301
1368994831,8cyclictest25-21ksoftirqd/122:05:291
1368994827,5cyclictest25-21ksoftirqd/121:45:311
1368994826,5cyclictest25-21ksoftirqd/122:55:191
1368994825,5cyclictest25-21ksoftirqd/121:41:101
136899481,7cyclictest241ktimersoftd/119:40:251
136899481,7cyclictest241ktimersoftd/119:40:251
136899480,9cyclictest241ktimersoftd/120:40:011
136799484,4cyclictest121rcu_preempt21:00:160
136799483,7cyclictest9-21ksoftirqd/000:20:380
1367994827,8cyclictest9-21ksoftirqd/020:40:300
117691480,8ptp4l137099cyclictest20:45:313
117691480,2ptp4l0-21swapper/323:27:213
117691480,2ptp4l0-21swapper/322:10:533
117691480,2ptp4l0-21swapper/322:10:523
117691480,2ptp4l0-21swapper/319:16:523
117691480,2ptp4l0-21swapper/221:41:362
117691480,2ptp4l0-21swapper/221:13:342
117691480,2ptp4l0-21swapper/200:22:342
117691480,2ptp4l0-21swapper/120:55:031
117691480,1ptp4l0-21swapper/322:20:213
117691480,1ptp4l0-21swapper/322:09:213
117691480,1ptp4l0-21swapper/320:15:343
117691480,1ptp4l0-21swapper/221:18:322
117691480,1ptp4l0-21swapper/219:35:182
117691480,1ptp4l0-21swapper/219:35:172
117691480,12ptp4l0-21swapper/023:26:200
1368994731,7cyclictest25-21ksoftirqd/120:15:221
1368994721,10cyclictest25-21ksoftirqd/121:32:331
136899471,8cyclictest241ktimersoftd/122:45:341
136899471,43cyclictest241ktimersoftd/121:15:171
136899470,7cyclictest241ktimersoftd/119:55:211
136799474,6cyclictest9-21ksoftirqd/021:05:290
136799473,7cyclictest9-21ksoftirqd/022:35:210
136799473,4cyclictest121rcu_preempt20:05:230
1367994733,3cyclictest9-21ksoftirqd/021:25:020
1367994731,4cyclictest9-21ksoftirqd/020:45:150
136799471,7cyclictest9-21ksoftirqd/019:25:190
117691470,2ptp4l0-21swapper/323:31:463
117691470,2ptp4l0-21swapper/323:31:453
117691470,2ptp4l0-21swapper/321:45:203
117691470,2ptp4l0-21swapper/321:05:183
117691470,2ptp4l0-21swapper/219:28:302
117691470,2ptp4l0-21swapper/200:04:542
117691470,2ptp4l0-21swapper/123:47:341
117691470,1ptp4l0-21swapper/322:47:043
117691470,1ptp4l0-21swapper/321:11:563
117691470,1ptp4l0-21swapper/223:51:572
117691470,1ptp4l0-21swapper/220:38:562
117691470,1ptp4l0-21swapper/100:18:131
117691470,10ptp4l0-21swapper/019:37:100
117691470,10ptp4l0-21swapper/019:37:100
1370994626,3cyclictest41-21ksoftirqd/323:00:173
136899468,8cyclictest25-21ksoftirqd/122:00:591
136899466,7cyclictest25-21ksoftirqd/120:25:381
136899465,7cyclictest241ktimersoftd/121:00:251
136899464,7cyclictest25-21ksoftirqd/120:50:341
136899464,6cyclictest25-21ksoftirqd/120:34:131
136899461,8cyclictest22279-21latency_hist19:55:001
1367994628,5cyclictest9-21ksoftirqd/021:10:290
1367994628,5cyclictest9-21ksoftirqd/019:15:270
136799462,6cyclictest9-21ksoftirqd/022:10:270
136799462,6cyclictest9-21ksoftirqd/022:10:260
117691460,8ptp4l0-21swapper/200:09:102
117691460,7ptp4l0-21swapper/223:49:002
117691460,5ptp4l25-21ksoftirqd/121:35:181
117691460,2ptp4l0-21swapper/321:03:583
117691460,2ptp4l0-21swapper/200:27:522
117691460,1ptp4l0-21swapper/221:53:092
117691460,11ptp4l0-21swapper/019:13:110
1370994512,9cyclictest41-21ksoftirqd/323:50:373
1368994530,7cyclictest25-21ksoftirqd/122:20:341
1368994525,5cyclictest25-21ksoftirqd/123:25:251
136899450,8cyclictest241ktimersoftd/119:45:201
136799457,8cyclictest9-21ksoftirqd/000:25:200
136799457,3cyclictest9-21ksoftirqd/019:30:150
136799456,4cyclictest9-21ksoftirqd/019:40:290
136799456,4cyclictest9-21ksoftirqd/019:40:280
136799453,4cyclictest9-21ksoftirqd/020:15:010
1367994533,3cyclictest9-21ksoftirqd/019:55:250
1367994531,3cyclictest9-21ksoftirqd/020:50:260
1367994527,5cyclictest9-21ksoftirqd/023:40:330
117691450,8ptp4l0-21swapper/022:24:500
117691450,7ptp4l0-21swapper/223:41:372
117691450,7ptp4l0-21swapper/200:38:402
117691450,7ptp4l0-21swapper/022:17:000
117691450,4ptp4l11696-21apt-get21:50:170
117691450,4ptp4l0-21swapper/320:12:583
117691450,2ptp4l0-21swapper/222:46:132
117691450,2ptp4l0-21swapper/220:25:432
117691450,2ptp4l0-21swapper/022:51:450
136899444,8cyclictest25-21ksoftirqd/123:15:311
136899444,7cyclictest25-21ksoftirqd/121:55:251
1368994428,8cyclictest25-21ksoftirqd/120:20:371
136799443,8cyclictest9-21ksoftirqd/020:30:220
1367994433,3cyclictest9-21ksoftirqd/000:00:200
1367994431,3cyclictest9-21ksoftirqd/021:40:240
1367994429,4cyclictest9-21ksoftirqd/023:30:310
1367994429,4cyclictest9-21ksoftirqd/023:30:300
1367994416,7cyclictest9-21ksoftirqd/020:25:410
136799440,8cyclictest9-21ksoftirqd/019:20:270
117691440,2ptp4l0-21swapper/219:40:412
117691440,2ptp4l0-21swapper/219:40:402
117691440,2ptp4l0-21swapper/219:23:262
117691440,2ptp4l0-21swapper/200:34:532
117691440,1ptp4l0-21swapper/323:46:123
117691440,1ptp4l0-21swapper/319:27:473
117691440,1ptp4l0-21swapper/222:00:122
117691440,1ptp4l0-21swapper/122:44:231
1370994328,4cyclictest41-21ksoftirqd/300:20:233
1370994315,5cyclictest41-21ksoftirqd/321:15:253
1370994315,4cyclictest41-21ksoftirqd/300:15:313
136899433,7cyclictest25-21ksoftirqd/122:35:131
136899432,7cyclictest25-21ksoftirqd/122:30:001
136799435,7cyclictest9-21ksoftirqd/020:55:250
1367994328,5cyclictest9-21ksoftirqd/022:10:000
1367994327,4cyclictest9-21ksoftirqd/023:45:250
136799431,8cyclictest9-21ksoftirqd/020:20:010
136799431,6cyclictest3423-21/usr/sbin/munin21:30:260
117691430,2ptp4l0-21swapper/319:43:293
117691430,2ptp4l0-21swapper/319:43:283
117691430,2ptp4l0-21swapper/219:52:072
1370994216,3cyclictest41-21ksoftirqd/300:00:323
136899425,7cyclictest25-21ksoftirqd/120:10:281
136899424,6cyclictest241ktimersoftd/120:05:241
136799422,4cyclictest9-21ksoftirqd/019:45:230
137099418,10cyclictest41-21ksoftirqd/300:35:203
136799414,3cyclictest9-21ksoftirqd/022:00:250
117691410,5ptp4l3983-21meminfo22:40:262
117691410,2ptp4l0-21swapper/200:19:122
117691410,2ptp4l0-21swapper/200:10:152
117691410,2ptp4l0-21swapper/022:46:530
117691380,3ptp4l11047-21apt-get20:40:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional