You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-09 - 00:06

x86 Intel Atom E3845 @1910 MHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot1.osadl.org (updated Mon Aug 08, 2022 12:46:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
354721820,8sleep22878099cyclictest07:25:122
1176911770,14ptp4l0-21swapper/207:09:462
1176911590,54ptp4l0-21swapper/107:07:451
1176911450,42ptp4l0-21swapper/307:05:433
1176911420,14ptp4l0-21swapper/007:08:380
117691640,5ptp4l19387-21users12:30:351
117691630,3ptp4l8869-21seq09:51:163
117691620,2ptp4l0-21swapper/310:26:113
117691610,2ptp4l0-21swapper/312:24:083
117691610,2ptp4l0-21swapper/310:35:233
117691590,2ptp4l0-21swapper/211:45:212
117691590,2ptp4l0-21swapper/208:10:202
117691590,1ptp4l0-21swapper/309:09:253
117691590,1ptp4l0-21swapper/211:10:202
117691590,1ptp4l0-21swapper/011:11:260
117691580,1ptp4l0-21swapper/310:11:593
117691580,1ptp4l0-21swapper/310:11:593
117691580,1ptp4l0-21swapper/307:43:203
117691570,2ptp4l0-21swapper/312:32:293
117691570,2ptp4l0-21swapper/308:11:053
117691570,1ptp4l0-21swapper/311:22:373
28778995625,10cyclictest9-21ksoftirqd/011:40:330
117691560,5ptp4l4365-21taskset09:42:553
117691560,1ptp4l0-21swapper/312:19:193
322712550,2sleep30-21swapper/309:35:003
28778995527,6cyclictest9-21ksoftirqd/008:55:270
117691550,2ptp4l0-21swapper/310:20:333
117691550,2ptp4l0-21swapper/310:05:423
117691550,2ptp4l0-21swapper/310:05:413
117691550,2ptp4l0-21swapper/307:15:163
117691550,1ptp4l0-21swapper/310:17:313
2877899547,11cyclictest9-21ksoftirqd/007:40:400
28778995424,10cyclictest9-21ksoftirqd/011:00:320
28778995424,10cyclictest9-21ksoftirqd/009:00:340
28778995424,10cyclictest9-21ksoftirqd/008:45:180
28778995423,10cyclictest9-21ksoftirqd/012:00:310
28778995423,10cyclictest9-21ksoftirqd/008:40:270
117691540,2ptp4l0-21swapper/312:05:003
117691540,2ptp4l0-21swapper/310:58:533
117691540,2ptp4l0-21swapper/308:50:223
117691540,11ptp4l0-21swapper/309:13:503
2877899538,10cyclictest9-21ksoftirqd/010:35:010
2877899536,10cyclictest9-21ksoftirqd/012:15:190
28778995326,9cyclictest9-21ksoftirqd/008:30:010
28778995323,10cyclictest9-21ksoftirqd/008:25:190
28778995323,10cyclictest9-21ksoftirqd/007:55:220
117691530,2ptp4l0-21swapper/310:40:103
117691530,2ptp4l0-21swapper/308:44:253
117691530,2ptp4l0-21swapper/308:36:093
117691530,2ptp4l0-21swapper/307:25:433
117691530,2ptp4l0-21swapper/209:00:342
117691530,1ptp4l0-21swapper/312:38:153
117691530,1ptp4l0-21swapper/112:03:571
2877899527,9cyclictest9-21ksoftirqd/009:35:220
2877899527,9cyclictest9-21ksoftirqd/009:25:360
2877899527,10cyclictest9-21ksoftirqd/012:35:190
2877899527,10cyclictest9-21ksoftirqd/012:20:320
2877899527,10cyclictest9-21ksoftirqd/007:10:390
2877899525,10cyclictest9-21ksoftirqd/009:50:410
2877899524,8cyclictest9-21ksoftirqd/012:30:350
2877899522,8cyclictest101ktimersoftd/008:50:260
117691520,3ptp4l1159-21snmpd11:03:372
117691520,2ptp4l0-21swapper/307:39:383
117691520,2ptp4l0-21swapper/212:31:312
117691520,2ptp4l0-21swapper/212:27:462
117691520,2ptp4l0-21swapper/210:21:512
117691520,2ptp4l0-21swapper/207:35:202
117691520,1ptp4l0-21swapper/312:08:393
2877899517,8cyclictest9-21ksoftirqd/008:25:000
2877899517,10cyclictest9-21ksoftirqd/009:40:370
2877899516,9cyclictest9-21ksoftirqd/012:25:140
2877899516,9cyclictest9-21ksoftirqd/011:30:290
2877899516,9cyclictest9-21ksoftirqd/011:30:280
2877899516,7cyclictest9-21ksoftirqd/010:15:210
2877899516,10cyclictest9-21ksoftirqd/007:20:250
2877899515,8cyclictest9-21ksoftirqd/007:30:000
2877899514,7cyclictest9-21ksoftirqd/009:25:000
2877899512,7cyclictest9-21ksoftirqd/011:35:230
28778995122,9cyclictest9-21ksoftirqd/010:20:340
2877899510,9cyclictest101ktimersoftd/009:15:200
18232510,1sleep30-21swapper/308:30:123
117691510,2ptp4l0-21swapper/311:35:443
117691510,2ptp4l0-21swapper/309:02:343
117691510,2ptp4l0-21swapper/308:06:253
117691510,2ptp4l0-21swapper/012:05:060
117691510,2ptp4l0-21swapper/010:38:070
117691510,1ptp4l0-21swapper/309:15:563
117691510,1ptp4l0-21swapper/308:21:413
117691510,1ptp4l0-21swapper/209:25:272
117691510,14ptp4l29138-21tr11:45:170
2877899507,9cyclictest9-21ksoftirqd/012:10:340
2877899507,10cyclictest9-21ksoftirqd/010:05:250
2877899507,10cyclictest9-21ksoftirqd/010:05:240
2877899507,10cyclictest9-21ksoftirqd/008:00:350
2877899506,9cyclictest9-21ksoftirqd/009:10:280
2877899506,10cyclictest9-21ksoftirqd/009:05:280
2877899505,7cyclictest9-21ksoftirqd/010:50:400
2877899505,13cyclictest9-21ksoftirqd/011:50:240
2877899504,7cyclictest9-21ksoftirqd/007:55:010
2877899501,7cyclictest101ktimersoftd/010:45:250
2877899500,9cyclictest101ktimersoftd/011:25:160
2877899500,9cyclictest101ktimersoftd/010:55:220
2877899500,9cyclictest101ktimersoftd/008:20:000
117691500,3ptp4l41-21ksoftirqd/311:34:373
117691500,3ptp4l41-21ksoftirqd/311:34:373
117691500,2ptp4l0-21swapper/312:25:203
117691500,2ptp4l0-21swapper/310:00:383
117691500,2ptp4l0-21swapper/308:47:573
117691500,2ptp4l0-21swapper/211:29:132
117691500,2ptp4l0-21swapper/210:51:312
117691500,2ptp4l0-21swapper/208:43:562
117691500,1ptp4l0-21swapper/209:08:182
2877899496,10cyclictest9-21ksoftirqd/011:05:190
2877899496,10cyclictest9-21ksoftirqd/008:05:240
2877899496,10cyclictest9-21ksoftirqd/007:30:140
2877899496,10cyclictest9-21ksoftirqd/007:30:140
2877899496,10cyclictest9-21ksoftirqd/007:15:200
2877899494,7cyclictest9-21ksoftirqd/010:00:390
2877899493,8cyclictest9-21ksoftirqd/010:40:220
2877899493,7cyclictest9-21ksoftirqd/007:45:150
2877899492,8cyclictest9-21ksoftirqd/008:10:300
2877899490,7cyclictest101ktimersoftd/010:30:000
117691490,2ptp4l0-21swapper/311:45:123
117691490,2ptp4l0-21swapper/311:40:233
117691490,2ptp4l0-21swapper/310:34:073
117691490,2ptp4l0-21swapper/208:57:502
117691490,2ptp4l0-21swapper/207:42:312
117691490,2ptp4l0-21swapper/112:13:541
117691490,1ptp4l0-21swapper/307:47:543
117691490,1ptp4l0-21swapper/212:05:012
117691490,1ptp4l0-21swapper/210:36:352
117691490,1ptp4l0-21swapper/209:50:192
117691490,1ptp4l0-21swapper/207:53:042
28778994841,4cyclictest9-21ksoftirqd/010:10:050
28778994841,4cyclictest9-21ksoftirqd/010:10:040
2877899483,7cyclictest9-21ksoftirqd/011:15:220
28778994818,9cyclictest9-21ksoftirqd/008:35:340
2877899480,8cyclictest101ktimersoftd/009:50:000
117691480,2ptp4l0-21swapper/310:52:413
117691480,2ptp4l0-21swapper/310:46:003
117691480,2ptp4l0-21swapper/309:29:463
117691480,2ptp4l0-21swapper/210:02:162
117691480,2ptp4l0-21swapper/109:03:441
117691480,1ptp4l0-21swapper/309:46:433
117691480,1ptp4l0-21swapper/308:03:573
117691480,1ptp4l0-21swapper/211:51:432
117691480,1ptp4l0-21swapper/211:41:512
117691480,1ptp4l0-21swapper/211:32:572
117691480,1ptp4l0-21swapper/211:32:562
117691480,1ptp4l0-21swapper/211:15:592
117691480,1ptp4l0-21swapper/210:32:272
117691480,1ptp4l0-21swapper/209:42:292
117691480,1ptp4l0-21swapper/209:33:372
117691480,1ptp4l0-21swapper/209:13:352
117691480,1ptp4l0-21swapper/208:50:492
117691480,1ptp4l0-21swapper/208:05:132
117691480,1ptp4l0-21swapper/207:19:402
117691480,1ptp4l0-21swapper/110:15:221
2877899474,7cyclictest9-21ksoftirqd/011:20:360
2877899473,7cyclictest9-21ksoftirqd/011:55:320
2877899473,10cyclictest9-21ksoftirqd/009:55:010
117691470,9ptp4l0-21swapper/007:35:050
117691470,2ptp4l0-21swapper/312:10:113
117691470,2ptp4l0-21swapper/309:38:233
117691470,2ptp4l0-21swapper/308:55:233
117691470,2ptp4l0-21swapper/307:53:453
117691470,2ptp4l0-21swapper/212:18:152
117691470,2ptp4l0-21swapper/211:36:442
117691470,2ptp4l0-21swapper/208:27:292
117691470,1ptp4l0-21swapper/311:14:553
117691470,1ptp4l0-21swapper/210:43:492
117691470,1ptp4l0-21swapper/210:07:272
117691470,1ptp4l0-21swapper/210:07:262
117691470,1ptp4l0-21swapper/209:59:202
117691470,1ptp4l0-21swapper/209:48:392
117691470,1ptp4l0-21swapper/209:22:402
117691470,1ptp4l0-21swapper/208:45:132
117691470,1ptp4l0-21swapper/208:32:492
117691470,1ptp4l0-21swapper/207:47:032
117691470,1ptp4l0-21swapper/207:23:392
117691470,10ptp4l0-21swapper/009:30:270
2878099461,4cyclictest117691ptp4l10:15:072
117691460,2ptp4l0-21swapper/311:30:003
117691460,2ptp4l0-21swapper/311:06:353
117691460,2ptp4l0-21swapper/307:55:483
117691460,2ptp4l0-21swapper/211:59:292
117691460,1ptp4l0-21swapper/311:55:393
117691460,1ptp4l0-21swapper/308:15:533
117691460,1ptp4l0-21swapper/212:01:522
117691460,1ptp4l0-21swapper/210:58:072
117691460,1ptp4l0-21swapper/208:37:442
117691460,1ptp4l0-21swapper/208:16:362
117691450,8ptp4l0-21swapper/309:56:233
117691450,4ptp4l0-21swapper/108:25:211
117691450,2ptp4l0-21swapper/309:21:143
117691450,2ptp4l0-21swapper/209:19:442
117691450,2ptp4l0-21swapper/207:13:192
117691450,1ptp4l0-21swapper/211:06:212
117691440,5ptp4l0-21swapper/307:20:163
117691440,2ptp4l0-21swapper/311:01:353
117691440,2ptp4l0-21swapper/208:00:542
117691440,2ptp4l0-21swapper/112:38:441
117691440,2ptp4l0-21swapper/107:16:281
117691440,1ptp4l0-21swapper/212:21:562
117691430,8ptp4l1142-21runrttasks11:17:303
117691430,5ptp4l27703-21ntp_states11:40:311
117691430,2ptp4l0-21swapper/308:26:293
117691430,2ptp4l0-21swapper/210:46:172
117691430,2ptp4l0-21swapper/209:39:192
117691430,1ptp4l0-21swapper/307:30:433
117691430,1ptp4l0-21swapper/307:30:433
117691430,1ptp4l0-21swapper/307:12:303
117691430,1ptp4l0-21swapper/208:21:412
117691430,1ptp4l0-21swapper/207:31:242
117691430,1ptp4l0-21swapper/207:31:242
117691420,6ptp4l27363-21diskstats08:15:161
117691420,5ptp4l29429-21memory10:35:341
117691420,3ptp4l31434-21apt-get11:50:051
117691420,2ptp4l0-21swapper/111:25:131
117691420,2ptp4l0-21swapper/108:49:201
117691420,1ptp4l0-21swapper/210:11:382
117691420,1ptp4l0-21swapper/210:11:372
117691410,5ptp4l30601-21ps08:20:261
117691410,5ptp4l17842-21hddtemp_smartct11:20:231
117691410,4ptp4l6143-21iostat10:55:231
117691410,4ptp4l2078-21awk10:45:331
117691410,4ptp4l12453-21ntp_states08:50:281
117691410,2ptp4l0-21swapper/212:36:362
117691410,2ptp4l0-21swapper/210:27:532
117691410,2ptp4l0-21swapper/207:56:342
117691410,2ptp4l0-21swapper/110:52:251
117691410,2ptp4l0-21swapper/107:52:281
117691400,5ptp4l17550-21latency_hist12:30:001
117691400,4ptp4l2854-21ls08:30:261
117691400,4ptp4l14200-21hddtemp_smartct08:55:181
117691400,2ptp4l0-21swapper/212:11:552
117691400,2ptp4l0-21swapper/111:04:341
117691400,12ptp4l0-21swapper/107:27:261
117691390,8ptp4l0-21swapper/109:35:451
117691390,5ptp4l28118-21taskset10:34:171
117691390,4ptp4l33-21ksoftirqd/211:20:262
117691390,4ptp4l25583-21sensors_temp11:35:351
117691390,4ptp4l15071-21cpuspeed11:15:171
117691390,4ptp4l13121-21ntp_states10:00:351
117691390,2ptp4l0-21swapper/107:48:551
28779993831,4cyclictest25-21ksoftirqd/108:05:381
2877999381,3cyclictest25-21ksoftirqd/107:10:351
117691380,5ptp4l1159-21snmpd11:50:093
117691380,2ptp4l0-21swapper/109:20:291
117691380,2ptp4l0-21swapper/109:15:351
2877999376,4cyclictest25-21ksoftirqd/109:05:261
28779993730,4cyclictest25-21ksoftirqd/110:10:211
28779993730,4cyclictest25-21ksoftirqd/110:10:211
28779993730,4cyclictest25-21ksoftirqd/107:40:271
117691370,2ptp4l0-21swapper/112:15:551
117691370,2ptp4l0-21swapper/112:09:541
117691370,2ptp4l0-21swapper/110:25:471
117691370,2ptp4l0-21swapper/110:06:341
117691370,2ptp4l0-21swapper/110:06:331
117691370,2ptp4l0-21swapper/109:55:281
117691370,2ptp4l0-21swapper/109:45:331
117691370,2ptp4l0-21swapper/109:10:241
117691370,2ptp4l0-21swapper/108:36:591
117691370,10ptp4l0-21swapper/108:43:131
2877999364,4cyclictest25-21ksoftirqd/110:40:291
28779993631,3cyclictest25-21ksoftirqd/107:30:481
28779993631,3cyclictest25-21ksoftirqd/107:30:481
28779993630,4cyclictest25-21ksoftirqd/111:10:181
28779993630,4cyclictest25-21ksoftirqd/109:30:201
28779993630,3cyclictest25-21ksoftirqd/109:25:181
117691360,2ptp4l0-21swapper/111:30:371
117691360,2ptp4l0-21swapper/111:30:361
117691360,2ptp4l0-21swapper/111:09:081
117691360,2ptp4l0-21swapper/109:40:031
117691360,2ptp4l0-21swapper/107:59:351
117691360,1ptp4l0-21swapper/112:23:361
117691360,1ptp4l0-21swapper/109:54:451
117691360,1ptp4l0-21swapper/108:13:531
28779993529,4cyclictest25-21ksoftirqd/111:45:241
28779993528,4cyclictest25-21ksoftirqd/107:20:191
117691350,2ptp4l0-21swapper/111:55:351
117691350,1ptp4l0-21swapper/110:20:011
117691350,1ptp4l0-21swapper/108:00:321
117691350,1ptp4l0-21swapper/107:35:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional