You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-07-29 - 18:36

Intel(R) Atom(TM) CPU E3845 @ 1.91GHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot1.osadl.org (updated Thu Jul 29, 2021 12:46:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1146912040,15ptp4l215-21systemd-journal07:09:080
1146911670,14ptp4l0-21swapper/107:06:021
1146911550,7ptp4l0-21swapper/307:05:153
1549421510,8sleep02974899cyclictest08:10:220
29085211592,10sleep20-21swapper/207:05:542
29748998578,5cyclictest9-21ksoftirqd/007:30:150
320172820,3sleep20-21swapper/211:50:132
29748997568,4cyclictest9-21ksoftirqd/011:05:150
29748997366,4cyclictest9-21ksoftirqd/010:35:140
39932720,6sleep02974899cyclictest08:35:190
29751997264,5cyclictest33-21ksoftirqd/209:20:122
29751997164,4cyclictest33-21ksoftirqd/211:40:142
29748997161,6cyclictest9-21ksoftirqd/008:50:140
29748997062,4cyclictest9-21ksoftirqd/007:25:140
114691700,5ptp4l11911-21cpuspeed_turbos08:45:151
114691700,1ptp4l0-21swapper/007:37:230
114691690,4ptp4l29199-21meminfo10:25:401
29751996862,4cyclictest33-21ksoftirqd/207:25:152
29751996860,4cyclictest33-21ksoftirqd/212:00:152
114691680,2ptp4l0-21swapper/109:35:311
29748996761,3cyclictest9-21ksoftirqd/012:35:160
114691670,5ptp4l5403-21/usr/sbin/munin07:20:050
29751996658,5cyclictest33-21ksoftirqd/208:20:162
114691660,4ptp4l14569-21irqrtprio08:50:051
114691660,2ptp4l0-21swapper/010:00:240
114691660,2ptp4l0-21swapper/009:15:020
114691650,4ptp4l3600-21ls10:35:131
114691650,2ptp4l0-21swapper/112:32:431
114691650,19ptp4l0-21swapper/009:57:450
29751996253,5cyclictest33-21ksoftirqd/211:10:132
114691620,2ptp4l0-21swapper/210:55:302
29752996147,7cyclictest41-21ksoftirqd/309:45:133
29748996153,4cyclictest9-21ksoftirqd/011:00:150
114691610,3ptp4l24064-21apt-get11:00:153
114691610,3ptp4l19209-21/usr/sbin/munin11:35:091
114691610,2ptp4l0-21swapper/108:20:061
114691600,4ptp4l27055-21ntp_states11:05:073
114691600,2ptp4l0-21swapper/311:20:333
114691600,2ptp4l0-21swapper/311:20:323
114691600,2ptp4l0-21swapper/308:40:343
114691600,2ptp4l0-21swapper/010:10:030
114691590,2ptp4l0-21swapper/308:25:083
114691590,2ptp4l0-21swapper/107:25:201
114691590,2ptp4l0-21swapper/007:55:020
29748995850,4cyclictest9-21ksoftirqd/008:45:160
114691580,3ptp4l5149-21python09:55:341
114691580,2ptp4l0-21swapper/110:40:371
114691580,2ptp4l0-21swapper/109:30:091
114691580,2ptp4l0-21swapper/108:40:101
114691580,2ptp4l0-21swapper/107:40:031
114691580,2ptp4l0-21swapper/007:52:290
114691580,15ptp4l0-21swapper/212:25:342
29751995749,5cyclictest33-21ksoftirqd/207:45:162
29751995749,5cyclictest33-21ksoftirqd/207:45:152
29751995748,5cyclictest33-21ksoftirqd/212:20:162
29748995749,4cyclictest9-21ksoftirqd/010:05:150
220852570,4sleep322087-21irqrtprio07:40:063
114691570,2ptp4l0-21swapper/112:15:051
114691570,27ptp4l31671-21iostat_ios10:30:100
29748995648,4cyclictest9-21ksoftirqd/008:40:160
114691560,2ptp4l0-21swapper/312:18:433
114691560,2ptp4l0-21swapper/208:55:572
114691560,2ptp4l0-21swapper/111:32:401
114691560,2ptp4l0-21swapper/110:54:031
114691560,2ptp4l0-21swapper/110:20:241
114691560,2ptp4l0-21swapper/010:50:080
114691560,2ptp4l0-21swapper/009:35:070
317482550,2sleep30-21swapper/312:30:093
29751995547,4cyclictest33-21ksoftirqd/209:35:052
29751995534,10cyclictest33-21ksoftirqd/211:40:002
29748995548,4cyclictest9-21ksoftirqd/011:20:190
29748995548,4cyclictest9-21ksoftirqd/011:20:190
114691550,3ptp4l3910-21apt-get12:35:142
114691550,2ptp4l0-21swapper/210:30:112
114691550,2ptp4l0-21swapper/110:48:271
114691550,2ptp4l0-21swapper/107:15:211
114691550,2ptp4l0-21swapper/011:34:550
114691550,1ptp4l0-21swapper/108:00:111
29748995446,5cyclictest9-21ksoftirqd/010:25:150
29748995446,4cyclictest9-21ksoftirqd/010:20:150
29748995445,5cyclictest9-21ksoftirqd/011:35:230
29748995444,6cyclictest9-21ksoftirqd/009:30:180
74512530,2sleep10-21swapper/107:20:161
29748995346,4cyclictest9-21ksoftirqd/011:40:140
287842530,2sleep10-21swapper/107:45:341
287842530,2sleep10-21swapper/107:45:331
114691530,2ptp4l0-21swapper/311:19:273
114691530,2ptp4l0-21swapper/308:15:223
114691530,2ptp4l0-21swapper/210:20:132
114691530,2ptp4l0-21swapper/107:35:161
114691530,2ptp4l0-21swapper/012:10:120
114691530,2ptp4l0-21swapper/008:09:270
29751995241,7cyclictest33-21ksoftirqd/207:55:192
114691520,2ptp4l0-21swapper/309:05:203
114691520,2ptp4l0-21swapper/309:03:593
114691520,2ptp4l0-21swapper/309:03:583
114691520,2ptp4l0-21swapper/209:10:032
114691520,2ptp4l0-21swapper/207:23:302
114691520,2ptp4l0-21swapper/111:52:001
114691520,2ptp4l0-21swapper/107:10:211
114691520,1ptp4l0-21swapper/111:55:321
114691520,14ptp4l0-21swapper/108:15:071
29751995143,5cyclictest33-21ksoftirqd/209:00:152
29751995143,5cyclictest33-21ksoftirqd/209:00:152
29751995140,7cyclictest33-21ksoftirqd/208:10:152
114691510,2ptp4l0-21swapper/110:17:051
114691510,2ptp4l0-21swapper/110:10:091
114691510,2ptp4l0-21swapper/008:55:590
114691510,2ptp4l0-21swapper/008:32:050
114691510,1ptp4l0-21swapper/309:19:563
114691510,1ptp4l0-21swapper/108:26:151
114691510,1ptp4l0-21swapper/107:56:071
114691510,15ptp4l27987-21acpi09:05:160
114691500,2ptp4l0-21swapper/310:45:213
114691500,2ptp4l0-21swapper/308:50:593
114691500,2ptp4l0-21swapper/209:55:052
114691500,2ptp4l0-21swapper/112:12:411
114691500,2ptp4l0-21swapper/110:08:521
114691500,2ptp4l0-21swapper/109:28:071
114691500,2ptp4l0-21swapper/109:05:531
114691500,2ptp4l0-21swapper/108:35:061
114691500,2ptp4l0-21swapper/108:10:251
114691500,2ptp4l0-21swapper/107:50:121
114691500,2ptp4l0-21swapper/012:08:140
114691500,1ptp4l0-21swapper/310:37:353
114691500,1ptp4l0-21swapper/110:32:301
29751994938,7cyclictest33-21ksoftirqd/209:05:142
29748994940,5cyclictest9-21ksoftirqd/011:45:140
114691490,2ptp4l0-21swapper/311:13:283
114691490,2ptp4l0-21swapper/310:34:273
114691490,2ptp4l0-21swapper/212:19:052
114691490,2ptp4l0-21swapper/211:24:092
114691490,2ptp4l0-21swapper/211:24:092
114691490,2ptp4l0-21swapper/211:16:192
114691490,2ptp4l0-21swapper/209:30:302
114691490,2ptp4l0-21swapper/208:53:152
114691490,2ptp4l0-21swapper/112:23:511
114691490,2ptp4l0-21swapper/112:09:131
114691490,2ptp4l0-21swapper/111:43:331
114691490,2ptp4l0-21swapper/111:16:421
114691490,2ptp4l0-21swapper/109:50:071
114691490,2ptp4l0-21swapper/108:55:341
114691490,2ptp4l0-21swapper/007:15:200
114691490,1ptp4l0-21swapper/208:30:062
114691490,1ptp4l0-21swapper/011:52:020
114691490,1ptp4l0-21swapper/007:42:270
114691490,1ptp4l0-21swapper/007:11:290
114691480,2ptp4l0-21swapper/310:22:453
114691480,2ptp4l0-21swapper/310:05:573
114691480,2ptp4l0-21swapper/309:43:453
114691480,2ptp4l0-21swapper/308:22:473
114691480,2ptp4l0-21swapper/209:52:002
114691480,2ptp4l0-21swapper/208:35:182
114691480,2ptp4l0-21swapper/208:04:002
114691480,2ptp4l0-21swapper/111:46:021
114691480,2ptp4l0-21swapper/111:27:241
114691480,2ptp4l0-21swapper/011:56:440
114691480,1ptp4l0-21swapper/312:29:333
114691480,1ptp4l0-21swapper/308:03:143
114691480,1ptp4l0-21swapper/307:50:473
114691480,1ptp4l0-21swapper/307:18:523
114691480,1ptp4l0-21swapper/211:08:202
114691480,1ptp4l0-21swapper/209:41:472
114691480,1ptp4l0-21swapper/109:49:501
114691480,1ptp4l0-21swapper/012:20:510
114691480,1ptp4l0-21swapper/010:15:590
114691480,1ptp4l0-21swapper/009:50:240
114691480,1ptp4l0-21swapper/009:24:530
29751994736,6cyclictest33-21ksoftirqd/210:10:152
114691470,2ptp4l0-21swapper/309:30:133
114691470,2ptp4l0-21swapper/309:26:373
114691470,1ptp4l0-21swapper/312:20:433
114691470,1ptp4l0-21swapper/210:04:552
114691470,1ptp4l0-21swapper/112:37:451
114691470,1ptp4l0-21swapper/111:22:131
114691470,1ptp4l0-21swapper/111:22:121
114691470,1ptp4l0-21swapper/111:02:421
114691470,1ptp4l0-21swapper/110:57:421
29751994639,4cyclictest33-21ksoftirqd/208:45:152
114691460,8ptp4l0-21swapper/312:03:023
114691460,8ptp4l0-21swapper/210:44:252
114691460,2ptp4l0-21swapper/310:13:113
114691460,2ptp4l0-21swapper/310:00:083
114691460,2ptp4l0-21swapper/008:28:310
114691460,1ptp4l0-21swapper/310:16:183
114691460,1ptp4l0-21swapper/308:56:063
114691460,1ptp4l0-21swapper/308:30:593
114691460,1ptp4l0-21swapper/012:16:360
114691460,15ptp4l0-21swapper/011:16:480
114691460,11ptp4l0-21swapper/207:50:172
114691460,11ptp4l0-21swapper/107:31:431
114691460,10ptp4l0-21swapper/309:11:233
114691450,9ptp4l0-21swapper/211:49:312
114691450,8ptp4l0-21swapper/310:28:523
114691450,8ptp4l0-21swapper/212:14:502
114691450,8ptp4l0-21swapper/211:58:572
114691450,8ptp4l0-21swapper/208:27:022
114691450,8ptp4l0-21swapper/207:35:512
114691450,8ptp4l0-21swapper/008:24:520
114691450,7ptp4l0-21swapper/307:26:043
114691450,5ptp4l483-21hddtemp_smartct12:30:230
114691450,2ptp4l0-21swapper/312:35:093
114691450,2ptp4l0-21swapper/309:54:483
114691450,2ptp4l0-21swapper/210:05:152
114691450,2ptp4l0-21swapper/109:15:041
114691450,2ptp4l0-21swapper/010:49:390
114691450,2ptp4l0-21swapper/009:26:580
114691450,1ptp4l0-21swapper/110:03:401
114691450,1ptp4l0-21swapper/009:13:130
29752994437,4cyclictest41-21ksoftirqd/307:10:153
114691440,9ptp4l0-21swapper/210:53:292
114691440,8ptp4l0-21swapper/307:49:043
114691440,8ptp4l0-21swapper/307:49:033
114691440,7ptp4l0-21swapper/207:17:142
114691440,7ptp4l0-21swapper/008:16:500
114691440,2ptp4l0-21swapper/210:39:112
114691440,2ptp4l0-21swapper/208:15:172
114691440,2ptp4l0-21swapper/112:01:351
114691440,2ptp4l0-21swapper/109:23:361
114691440,1ptp4l0-21swapper/308:46:083
114691440,1ptp4l0-21swapper/210:47:402
114691440,1ptp4l0-21swapper/009:40:460
114691430,4ptp4l7042-21iostat_ios08:40:102
114691430,4ptp4l12101-21meminfo08:05:252
114691430,2ptp4l0-21swapper/010:40:450
114691430,1ptp4l0-21swapper/209:46:362
114691430,1ptp4l0-21swapper/011:28:180
114691430,10ptp4l0-21swapper/007:47:130
114691430,10ptp4l0-21swapper/007:47:130
29748994236,3cyclictest9-21ksoftirqd/010:55:140
29748994231,6cyclictest9-21ksoftirqd/012:00:140
114691420,4ptp4l13414-21smartctl12:05:392
114691420,3ptp4l30184-21needreboot08:30:001
114691420,3ptp4l29321-21meminfo12:25:350
114691420,1ptp4l0-21swapper/108:08:281
29748994114,4cyclictest9-21ksoftirqd/009:00:120
29748994114,4cyclictest9-21ksoftirqd/009:00:110
114691410,8ptp4l0-21swapper/311:56:113
114691410,6ptp4l7397-21df08:00:170
114691410,5ptp4l20008-21/usr/sbin/munin10:15:132
114691410,5ptp4l0-21swapper/109:01:391
114691410,5ptp4l0-21swapper/109:01:381
114691410,4ptp4l20055-21apt-get11:35:153
114691410,2ptp4l0-21swapper/310:50:033
114691410,2ptp4l0-21swapper/308:38:063
114691410,2ptp4l0-21swapper/308:12:223
114691410,2ptp4l0-21swapper/307:22:343
114691410,2ptp4l0-21swapper/210:29:202
114691410,2ptp4l0-21swapper/207:10:592
114691400,5ptp4l31025-21diskstats12:30:052
114691400,5ptp4l27546-21/usr/sbin/munin09:45:110
114691400,4ptp4l2215-21sensors_temp09:55:013
114691400,4ptp4l17900-21apt-get09:35:033
114691400,4ptp4l13059-21ntp_states11:25:253
114691400,4ptp4l11045-21apt-get08:05:143
114691400,2ptp4l0-21swapper/312:05:423
114691400,2ptp4l0-21swapper/311:45:153
114691400,2ptp4l0-21swapper/311:41:403
114691400,2ptp4l0-21swapper/310:43:113
114691400,2ptp4l0-21swapper/309:21:043
114691400,2ptp4l0-21swapper/307:56:523
114691400,2ptp4l0-21swapper/307:30:533
114691400,2ptp4l0-21swapper/211:31:442
114691400,2ptp4l0-21swapper/211:26:292
114691400,2ptp4l0-21swapper/209:27:292
114691400,2ptp4l0-21swapper/209:16:032
114691400,2ptp4l0-21swapper/207:41:472
114691400,2ptp4l0-21swapper/111:13:191
114691400,2ptp4l0-21swapper/109:40:151
114691400,2ptp4l0-21swapper/109:12:011
114691400,2ptp4l0-21swapper/011:13:330
29751993933,3cyclictest33-21ksoftirqd/211:00:162
114691390,5ptp4l29458-21which11:05:321
114691390,4ptp4l27510-21irqstats12:25:091
114691390,2ptp4l0-21swapper/311:31:223
114691390,2ptp4l0-21swapper/310:55:453
114691390,2ptp4l0-21swapper/307:36:123
114691390,2ptp4l0-21swapper/207:31:212
114691380,2ptp4l0-21swapper/312:10:023
114691370,2ptp4l0-21swapper/311:52:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional