You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-02-05 - 00:02

x86 Intel Atom E3845 @1910 MHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot1.osadl.org (updated Sat Feb 04, 2023 12:46:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1176911810,7ptp4l0-21swapper/307:07:473
201721800,8sleep2993399cyclictest10:20:132
1176911800,14ptp4l0-21swapper/207:07:012
1176911670,30ptp4l9-21ksoftirqd/007:05:410
1176911640,13ptp4l0-21swapper/107:09:281
3023321580,6sleep1993299cyclictest07:50:291
117691730,6ptp4l9916-21cut07:10:010
248852710,9sleep2993399cyclictest07:40:232
117691680,2ptp4l0-21swapper/311:30:183
233042670,6sleep323306-21latency_hist12:15:003
117691670,5ptp4l16844-21vmstat08:30:322
117691670,3ptp4l15984-21mailstats07:20:372
117691670,22ptp4l31486-21memory12:30:242
117691670,1ptp4l0-21swapper/309:28:243
117691650,23ptp4l31929-21users11:20:322
117691640,2ptp4l0-21swapper/208:45:102
117691630,4ptp4l9673-21iostat_ios10:35:262
117691630,2ptp4l0-21swapper/008:47:230
117691630,2ptp4l0-21swapper/007:29:590
117691630,19ptp4l0-21swapper/212:27:552
117691620,17ptp4l0-21swapper/008:40:250
117691600,1ptp4l0-21swapper/007:38:460
59052590,4sleep35901-21awk09:20:003
117691590,2ptp4l0-21swapper/208:35:262
9934995821,9cyclictest41-21ksoftirqd/310:35:243
117691580,2ptp4l0-21swapper/207:35:182
117691580,2ptp4l0-21swapper/010:25:310
117691580,2ptp4l0-21swapper/009:24:200
117691580,14ptp4l0-21swapper/212:35:172
117691570,2ptp4l0-21swapper/211:11:052
117691570,2ptp4l0-21swapper/210:05:192
117691560,2ptp4l0-21swapper/312:35:173
117691560,2ptp4l0-21swapper/312:07:163
117691560,2ptp4l0-21swapper/211:05:272
117691560,2ptp4l0-21swapper/209:06:442
117691560,1ptp4l0-21swapper/209:12:412
993499557,10cyclictest41-21ksoftirqd/308:45:243
117691550,1ptp4l0-21swapper/307:25:373
117691550,1ptp4l0-21swapper/208:19:482
993499546,10cyclictest41-21ksoftirqd/308:40:003
993499545,7cyclictest41-21ksoftirqd/312:35:003
9934995424,7cyclictest41-21ksoftirqd/308:00:163
9934995423,4cyclictest41-21ksoftirqd/311:15:203
117691540,2ptp4l0-21swapper/311:55:003
117691540,2ptp4l0-21swapper/309:20:173
117691540,2ptp4l0-21swapper/211:41:242
117691540,1ptp4l0-21swapper/210:29:182
993499534,8cyclictest22418-21/usr/sbin/munin07:35:203
9934995324,10cyclictest41-21ksoftirqd/307:30:213
9934995323,7cyclictest41-21ksoftirqd/307:50:213
9934995322,7cyclictest41-21ksoftirqd/311:20:133
9934995320,5cyclictest41-21ksoftirqd/310:50:313
117691530,2ptp4l0-21swapper/312:21:503
117691530,2ptp4l0-21swapper/312:21:503
117691530,2ptp4l0-21swapper/312:15:083
117691530,2ptp4l0-21swapper/209:48:542
117691530,1ptp4l0-21swapper/312:29:273
993499526,9cyclictest41-21ksoftirqd/310:45:253
993499526,10cyclictest41-21ksoftirqd/310:20:233
993499526,10cyclictest41-21ksoftirqd/309:05:133
993499520,13cyclictest41-21ksoftirqd/310:00:133
117691520,2ptp4l0-21swapper/309:12:393
117691520,2ptp4l0-21swapper/308:24:493
117691520,2ptp4l0-21swapper/308:24:493
117691520,2ptp4l0-21swapper/208:09:392
117691520,2ptp4l0-21swapper/207:51:462
117691520,1ptp4l0-21swapper/208:25:452
9934995141,5cyclictest41-21ksoftirqd/307:20:223
993499514,10cyclictest41-21ksoftirqd/309:55:163
9934995135,12cyclictest41-21ksoftirqd/309:40:053
9934995135,12cyclictest41-21ksoftirqd/309:40:053
9934995121,5cyclictest41-21ksoftirqd/310:35:003
9934995119,8cyclictest41-21ksoftirqd/310:40:233
9934995119,5cyclictest41-21ksoftirqd/310:55:193
9934995119,5cyclictest41-21ksoftirqd/310:55:183
9934995119,5cyclictest41-21ksoftirqd/308:10:283
117691510,2ptp4l0-21swapper/311:56:053
117691510,2ptp4l0-21swapper/311:46:063
117691510,2ptp4l0-21swapper/309:51:123
117691510,2ptp4l0-21swapper/307:10:133
117691510,2ptp4l0-21swapper/210:40:322
117691510,2ptp4l0-21swapper/210:00:222
117691510,1ptp4l0-21swapper/312:00:143
117691510,1ptp4l0-21swapper/207:25:332
117691510,12ptp4l0-21swapper/212:20:352
117691510,12ptp4l0-21swapper/212:20:352
117691510,11ptp4l0-21swapper/108:20:551
117691510,11ptp4l0-21swapper/108:20:541
993499506,8cyclictest41-21ksoftirqd/310:05:243
993499505,10cyclictest41-21ksoftirqd/307:15:153
993499504,9cyclictest41-21ksoftirqd/309:35:343
993499504,7cyclictest41-21ksoftirqd/309:30:333
993499502,8cyclictest41-21ksoftirqd/311:25:363
9934995021,7cyclictest41-21ksoftirqd/308:15:213
9934995018,10cyclictest41-21ksoftirqd/308:25:313
993499500,7cyclictest41-21ksoftirqd/311:00:143
993499500,7cyclictest41-21ksoftirqd/311:00:133
993499500,15cyclictest41-21ksoftirqd/311:05:153
117691500,2ptp4l0-21swapper/309:02:163
117691500,2ptp4l0-21swapper/308:59:263
117691500,2ptp4l0-21swapper/308:42:413
117691500,2ptp4l0-21swapper/212:01:062
117691500,2ptp4l0-21swapper/109:45:251
117691500,1ptp4l0-21swapper/211:31:032
117691500,1ptp4l0-21swapper/209:34:492
117691500,1ptp4l0-21swapper/209:24:012
117691500,1ptp4l0-21swapper/112:16:571
117691500,1ptp4l0-21swapper/108:32:411
117691500,1ptp4l0-21swapper/011:57:090
993499494,9cyclictest41-21ksoftirqd/308:30:133
993499493,9cyclictest41-21ksoftirqd/308:50:253
9934994919,7cyclictest41-21ksoftirqd/310:25:113
9934994919,11cyclictest41-21ksoftirqd/310:15:253
117691490,2ptp4l0-21swapper/311:13:483
117691490,2ptp4l0-21swapper/310:12:553
117691490,2ptp4l0-21swapper/212:18:042
117691490,2ptp4l0-21swapper/208:03:372
117691490,2ptp4l0-21swapper/011:52:440
117691490,2ptp4l0-21swapper/009:28:590
993499483,8cyclictest41-21ksoftirqd/307:45:153
9934994821,5cyclictest41-21ksoftirqd/309:45:313
9934994818,9cyclictest41-21ksoftirqd/307:40:293
117691480,9ptp4l0-21swapper/007:32:580
117691480,2ptp4l0-21swapper/211:56:522
117691480,2ptp4l0-21swapper/210:53:202
117691480,2ptp4l0-21swapper/010:53:470
117691480,2ptp4l0-21swapper/010:30:300
117691480,2ptp4l0-21swapper/008:07:110
117691480,1ptp4l0-21swapper/210:45:302
117691480,1ptp4l0-21swapper/208:14:342
117691480,1ptp4l0-21swapper/110:37:511
117691480,1ptp4l0-21swapper/110:21:061
993499477,5cyclictest41-21ksoftirqd/308:05:183
993499474,8cyclictest41-21ksoftirqd/311:40:163
117691470,8ptp4l0-21swapper/008:01:100
117691470,8ptp4l0-21swapper/007:59:590
117691470,2ptp4l0-21swapper/307:57:463
117691470,2ptp4l0-21swapper/211:47:262
117691470,2ptp4l0-21swapper/209:16:352
117691470,1ptp4l0-21swapper/207:56:292
117691470,1ptp4l0-21swapper/207:48:202
117691470,1ptp4l0-21swapper/111:43:431
117691470,1ptp4l0-21swapper/110:13:111
993499462,9cyclictest41-21ksoftirqd/311:35:163
117691460,8ptp4l0-21swapper/012:12:080
117691460,8ptp4l0-21swapper/009:41:350
117691460,8ptp4l0-21swapper/009:41:340
117691460,8ptp4l0-21swapper/008:19:580
117691460,8ptp4l0-21swapper/008:10:350
117691460,8ptp4l0-21swapper/007:16:000
117691460,7ptp4l0-21swapper/010:10:190
117691460,3ptp4l19515-21ls09:45:410
117691460,2ptp4l0-21swapper/209:26:352
117691460,2ptp4l0-21swapper/111:00:441
117691460,2ptp4l0-21swapper/111:00:441
117691460,1ptp4l0-21swapper/211:26:162
117691460,1ptp4l0-21swapper/210:56:322
117691460,1ptp4l0-21swapper/210:56:322
117691460,1ptp4l0-21swapper/209:39:042
117691460,1ptp4l0-21swapper/208:24:242
117691460,1ptp4l0-21swapper/208:24:232
117691460,1ptp4l0-21swapper/011:15:500
117691460,10ptp4l25-21ksoftirqd/112:26:441
117691450,9ptp4l0-21swapper/009:52:390
117691450,8ptp4l28106-21grep11:15:142
117691450,8ptp4l0-21swapper/011:44:410
117691450,8ptp4l0-21swapper/010:19:250
117691450,8ptp4l0-21swapper/009:33:110
117691450,8ptp4l0-21swapper/009:00:380
117691450,8ptp4l0-21swapper/008:58:180
117691450,8ptp4l0-21swapper/007:21:450
117691450,7ptp4l0-21swapper/012:35:360
117691450,7ptp4l0-21swapper/008:23:360
117691450,7ptp4l0-21swapper/008:23:350
117691450,7ptp4l0-21swapper/007:52:090
117691450,4ptp4l9-21ksoftirqd/012:06:190
117691450,4ptp4l26544-21apt-get07:45:130
117691450,3ptp4l9-21ksoftirqd/012:15:440
117691450,11ptp4l33-21ksoftirqd/207:30:252
117691450,10ptp4l1142-21runrttasks12:33:260
117691440,9ptp4l0-21swapper/011:21:440
117691440,8ptp4l0-21swapper/010:36:050
117691440,8ptp4l0-21swapper/008:33:260
117691440,7ptp4l25810-21irqrtprio10:00:200
117691440,7ptp4l0-21swapper/011:13:150
117691440,4ptp4l28210-21irqstats10:05:210
117691440,3ptp4l0-21swapper/011:45:320
117691440,2ptp4l0-21swapper/110:44:071
117691440,2ptp4l0-21swapper/109:40:321
117691440,2ptp4l0-21swapper/109:40:311
117691440,2ptp4l0-21swapper/012:20:150
117691440,2ptp4l0-21swapper/012:20:150
117691440,2ptp4l0-21swapper/009:11:570
117691440,1ptp4l0-21swapper/212:07:262
117691440,1ptp4l0-21swapper/208:54:072
117691440,1ptp4l0-21swapper/207:19:312
117691440,1ptp4l0-21swapper/008:35:430
117691430,9ptp4l0-21swapper/011:02:110
117691430,9ptp4l0-21swapper/011:02:100
117691430,7ptp4l0-21swapper/011:26:450
117691430,7ptp4l0-21swapper/010:46:570
117691430,2ptp4l0-21swapper/212:12:302
117691430,2ptp4l0-21swapper/208:58:322
117691430,1ptp4l0-21swapper/209:44:142
117691430,1ptp4l0-21swapper/209:44:132
117691420,8ptp4l0-21swapper/011:05:150
117691420,5ptp4l27202-21df_inode08:55:161
117691420,4ptp4l19857-21apt-get08:40:132
117691420,4ptp4l0-21swapper/211:37:562
117691420,2ptp4l0-21swapper/209:04:082
117691420,2ptp4l0-21swapper/108:28:131
117691420,2ptp4l0-21swapper/010:40:330
117691420,2ptp4l0-21swapper/009:38:390
117691420,2ptp4l0-21swapper/009:06:170
117691420,2ptp4l0-21swapper/008:50:220
117691420,1ptp4l0-21swapper/012:28:460
117691410,6ptp4l11462-21timerandwakeup07:10:312
117691410,5ptp4l5414-21hddtemp_smartct11:35:200
117691410,5ptp4l3783-21runrttasks10:21:430
117691410,5ptp4l1096-21memory11:25:291
117691410,5ptp4l10511-21perl07:10:171
117691410,2ptp4l0-21swapper/112:22:401
117691410,2ptp4l0-21swapper/112:22:401
117691410,2ptp4l0-21swapper/109:29:001
117691410,2ptp4l0-21swapper/109:19:431
117691410,2ptp4l0-21swapper/107:26:421
117691410,2ptp4l0-21swapper/012:04:140
117691410,2ptp4l0-21swapper/010:59:340
117691410,2ptp4l0-21swapper/010:59:340
117691410,2ptp4l0-21swapper/009:55:100
117691410,2ptp4l0-21swapper/009:15:060
117691410,2ptp4l0-21swapper/008:25:540
117691410,2ptp4l0-21swapper/007:40:580
117691410,11ptp4l0-21swapper/111:06:371
117691400,5ptp4l31769-21idleruntime-cro10:15:012
117691400,5ptp4l23755-21ntp_states09:55:272
117691400,5ptp4l22479-21latency_hist09:55:001
117691400,2ptp4l0-21swapper/210:32:572
117691400,2ptp4l0-21swapper/109:03:591
117691400,2ptp4l0-21swapper/011:30:580
117691390,5ptp4l22958-21cut08:45:201
117691390,4ptp4l12870-21ls11:50:231
117691390,4ptp4l1229-21awk10:15:322
117691390,3ptp4l14219-21apt-get11:55:211
117691390,2ptp4l0-21swapper/209:50:122
117691390,2ptp4l0-21swapper/110:04:141
117691390,2ptp4l0-21swapper/107:15:271
117691390,1ptp4l0-21swapper/109:12:361
117691380,4ptp4l9880-21chrt08:15:511
117691380,4ptp4l33-21ksoftirqd/211:54:592
117691380,4ptp4l28492-21ntpq10:05:261
117691380,2ptp4l0-21swapper/109:35:121
117691380,2ptp4l0-21swapper/109:24:101
117691370,2ptp4l0-21swapper/211:00:272
117691370,2ptp4l0-21swapper/211:00:272
117691370,2ptp4l0-21swapper/111:10:121
117691370,2ptp4l0-21swapper/110:45:211
117691370,2ptp4l0-21swapper/110:15:141
117691370,2ptp4l0-21swapper/109:56:541
117691370,2ptp4l0-21swapper/109:32:021
117691370,2ptp4l0-21swapper/108:37:281
117691370,2ptp4l0-21swapper/107:59:191
117691370,2ptp4l0-21swapper/107:45:361
117691370,2ptp4l0-21swapper/107:42:491
117691370,2ptp4l0-21swapper/107:35:011
117691370,1ptp4l0-21swapper/108:09:031
117691360,2ptp4l0-21swapper/112:32:131
117691360,2ptp4l0-21swapper/112:05:381
117691360,2ptp4l0-21swapper/110:59:431
117691360,2ptp4l0-21swapper/110:59:431
117691360,2ptp4l0-21swapper/110:51:431
117691360,2ptp4l0-21swapper/109:06:231
117691360,2ptp4l0-21swapper/108:50:221
117691360,2ptp4l0-21swapper/108:40:201
117691360,2ptp4l0-21swapper/107:20:411
117691360,1ptp4l0-21swapper/112:35:161
117691360,1ptp4l0-21swapper/111:48:421
117691360,1ptp4l0-21swapper/108:11:371
117691360,1ptp4l0-21swapper/108:04:291
117691350,2ptp4l0-21swapper/112:02:411
117691350,2ptp4l0-21swapper/111:21:131
117691350,2ptp4l0-21swapper/111:15:521
117691350,1ptp4l0-21swapper/112:10:081
117691350,1ptp4l0-21swapper/111:35:351
117691350,1ptp4l0-21swapper/111:30:021
117691350,1ptp4l0-21swapper/110:26:581
117691340,1ptp4l0-21swapper/110:32:391
117691310,1ptp4l0-21swapper/107:34:331
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional