You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-02-08 - 05:41

x86 Intel Atom E3845 @1910 MHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the alll highest latencies:
System rackdslot1.osadl.org (updated Wed Feb 08, 2023 00:46:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1176911780,15ptp4l0-21swapper/219:08:282
1176911630,11ptp4l0-21swapper/319:08:053
1176911450,14ptp4l0-21swapper/119:09:131
1176911360,46ptp4l0-21swapper/019:09:580
71682640,3sleep00-21swapper/022:10:360
117691610,3ptp4l0-21swapper/023:35:150
117691610,2ptp4l0-21swapper/319:40:313
117791600,7getstats1786299cyclictest21:25:452
117691600,2ptp4l0-21swapper/221:20:252
17860995952,4cyclictest9-21ksoftirqd/023:20:200
117691590,2ptp4l0-21swapper/220:05:192
117691580,2ptp4l0-21swapper/220:20:552
117691580,2ptp4l0-21swapper/021:09:260
117691580,1ptp4l0-21swapper/220:51:282
117691570,7ptp4l0-21swapper/000:19:410
117691570,7ptp4l0-21swapper/000:19:400
117691570,2ptp4l0-21swapper/222:54:392
117691570,2ptp4l0-21swapper/121:15:361
117691570,1ptp4l0-21swapper/222:23:302
17860995624,7cyclictest9-21ksoftirqd/023:30:250
117691560,2ptp4l0-21swapper/220:11:192
117691560,2ptp4l0-21swapper/020:46:370
117691560,2ptp4l0-21swapper/019:56:330
117691560,1ptp4l0-21swapper/222:35:242
117691560,1ptp4l0-21swapper/122:10:361
17860995527,4cyclictest9-21ksoftirqd/000:40:000
17860995521,9cyclictest9-21ksoftirqd/021:40:000
117691550,2ptp4l0-21swapper/222:30:292
117691550,2ptp4l0-21swapper/019:33:370
117691550,1ptp4l0-21swapper/323:39:443
117691550,1ptp4l0-21swapper/219:55:332
266352540,2sleep00-21swapper/000:00:320
17860995423,7cyclictest9-21ksoftirqd/020:05:000
17860995422,9cyclictest9-21ksoftirqd/000:05:190
117691540,2ptp4l0-21swapper/223:15:492
117691540,2ptp4l0-21swapper/220:00:192
117691540,2ptp4l0-21swapper/120:06:281
117691540,2ptp4l0-21swapper/019:28:400
117691540,1ptp4l0-21swapper/300:31:353
117691540,1ptp4l0-21swapper/223:28:082
17860995346,4cyclictest9-21ksoftirqd/019:10:130
17860995345,5cyclictest9-21ksoftirqd/020:40:040
17860995321,7cyclictest9-21ksoftirqd/020:30:220
117691530,2ptp4l0-21swapper/221:31:052
117691530,2ptp4l0-21swapper/219:13:302
117691530,1ptp4l0-21swapper/021:41:590
117691530,14ptp4l18471-21hddtemp_smartct19:10:183
17860995220,6cyclictest9-21ksoftirqd/020:25:280
117691520,2ptp4l0-21swapper/222:16:272
117691520,2ptp4l0-21swapper/200:05:342
117691520,2ptp4l0-21swapper/021:54:110
117691520,2ptp4l0-21swapper/021:54:100
117691520,2ptp4l0-21swapper/021:28:460
117691520,2ptp4l0-21swapper/020:19:110
117691520,2ptp4l0-21swapper/020:07:390
117691520,2ptp4l0-21swapper/019:54:210
117691520,1ptp4l0-21swapper/223:41:442
117691520,1ptp4l0-21swapper/020:53:550
1786099513,11cyclictest9-21ksoftirqd/021:00:340
17860995126,7cyclictest9-21ksoftirqd/019:35:370
17860995120,6cyclictest9-21ksoftirqd/023:50:280
117691510,2ptp4l0-21swapper/223:10:432
117691510,2ptp4l0-21swapper/223:05:222
117691510,2ptp4l0-21swapper/221:46:292
117691510,2ptp4l0-21swapper/221:46:292
117691510,2ptp4l0-21swapper/200:10:292
117691510,2ptp4l0-21swapper/123:30:221
117691510,2ptp4l0-21swapper/023:57:160
117691510,2ptp4l0-21swapper/021:45:360
117691510,2ptp4l0-21swapper/021:45:360
117691510,2ptp4l0-21swapper/020:13:340
117691510,1ptp4l0-21swapper/100:22:411
1786399502,3cyclictest117791getstats00:05:163
1786399500,6cyclictest5612-21ls19:50:253
1786099507,10cyclictest9-21ksoftirqd/023:15:330
1786099504,7cyclictest9-21ksoftirqd/000:20:170
17860995042,4cyclictest9-21ksoftirqd/022:55:040
17860995042,4cyclictest9-21ksoftirqd/022:55:040
17860995038,4cyclictest9-21ksoftirqd/021:30:210
17860995019,11cyclictest9-21ksoftirqd/023:10:250
117691500,3ptp4l0-21swapper/119:10:011
117691500,2ptp4l0-21swapper/219:51:532
117691500,2ptp4l0-21swapper/123:00:241
117691500,2ptp4l0-21swapper/123:00:241
117691500,2ptp4l0-21swapper/023:42:260
117691500,2ptp4l0-21swapper/023:04:010
117691500,2ptp4l0-21swapper/023:04:010
117691500,2ptp4l0-21swapper/021:16:400
117691500,1ptp4l0-21swapper/222:45:032
117691500,15ptp4l2999migration/222:55:262
117691500,15ptp4l2999migration/222:55:252
17863994942,4cyclictest18035-21cron23:45:003
1786099496,7cyclictest22445-21apt-config19:20:000
1786099496,4cyclictest9-21ksoftirqd/020:20:290
17860994920,4cyclictest9-21ksoftirqd/020:35:280
117691490,2ptp4l0-21swapper/223:52:112
117691490,2ptp4l0-21swapper/223:20:222
117691490,2ptp4l0-21swapper/219:42:012
117691490,2ptp4l0-21swapper/119:53:431
117691490,2ptp4l0-21swapper/119:27:081
117691490,2ptp4l0-21swapper/021:14:190
117691490,1ptp4l0-21swapper/223:03:352
117691490,1ptp4l0-21swapper/223:03:352
117691490,1ptp4l0-21swapper/200:25:462
1786099486,10cyclictest9-21ksoftirqd/023:45:240
17860994822,8cyclictest9-21ksoftirqd/019:20:340
117691480,6ptp4l25-21ksoftirqd/120:23:261
117691480,5ptp4l41-21ksoftirqd/320:40:233
117691480,2ptp4l0-21swapper/320:50:413
117691480,2ptp4l0-21swapper/320:00:293
117691480,2ptp4l0-21swapper/300:30:013
117691480,2ptp4l0-21swapper/222:08:082
117691480,2ptp4l0-21swapper/221:16:412
117691480,2ptp4l0-21swapper/220:47:482
117691480,2ptp4l0-21swapper/220:34:222
117691480,2ptp4l0-21swapper/200:31:512
117691480,1ptp4l0-21swapper/223:55:262
117691480,1ptp4l0-21swapper/223:45:062
117691480,1ptp4l0-21swapper/223:35:272
117691480,1ptp4l0-21swapper/223:33:382
117691480,1ptp4l0-21swapper/222:10:452
117691480,1ptp4l0-21swapper/219:39:332
117691480,1ptp4l0-21swapper/200:20:472
117691480,1ptp4l0-21swapper/200:03:502
117691480,12ptp4l4611-21timerandwakeup22:05:330
117691480,11ptp4l25-21ksoftirqd/121:50:301
117691480,11ptp4l25-21ksoftirqd/121:50:301
17860994737,3cyclictest9-21ksoftirqd/022:50:340
1786099471,7cyclictest9-21ksoftirqd/000:30:180
117691470,8ptp4l0-21swapper/020:58:020
117691470,2ptp4l0-21swapper/322:37:133
117691470,2ptp4l0-21swapper/321:59:073
117691470,2ptp4l0-21swapper/319:22:193
117691470,2ptp4l0-21swapper/222:42:402
117691470,2ptp4l0-21swapper/221:36:022
117691470,1ptp4l0-21swapper/221:10:112
117691470,1ptp4l0-21swapper/220:56:172
117691470,1ptp4l0-21swapper/219:33:442
117691470,1ptp4l0-21swapper/219:29:122
117691470,1ptp4l0-21swapper/200:39:282
117691470,1ptp4l0-21swapper/123:08:571
1786099465,4cyclictest501-21cut23:05:320
1786099464,7cyclictest9-21ksoftirqd/000:30:000
117691460,8ptp4l0-21swapper/221:41:102
117691460,1ptp4l0-21swapper/322:56:543
117691460,1ptp4l0-21swapper/322:56:543
117691460,1ptp4l0-21swapper/200:18:162
117691460,1ptp4l0-21swapper/200:18:152
117691460,1ptp4l0-21swapper/123:22:361
117691460,12ptp4l0-21swapper/220:16:122
117691460,11ptp4l29612-21ls20:40:322
1786099456,6cyclictest9-21ksoftirqd/022:45:360
1786099454,8cyclictest9-21ksoftirqd/019:45:180
1786099454,6cyclictest9-21ksoftirqd/022:15:160
1786099454,4cyclictest121rcu_preempt00:10:180
17860994537,5cyclictest9-21ksoftirqd/023:25:210
17860994526,9cyclictest9-21ksoftirqd/022:25:290
1786099450,7cyclictest21555-21sh22:45:000
117691450,7ptp4l0-21swapper/019:44:470
117691450,2ptp4l0-21swapper/322:46:133
117691450,2ptp4l0-21swapper/222:03:362
117691450,2ptp4l0-21swapper/221:06:272
117691450,2ptp4l0-21swapper/219:47:052
117691450,1ptp4l0-21swapper/323:20:333
117691450,1ptp4l0-21swapper/322:30:113
117691450,1ptp4l0-21swapper/321:02:493
117691450,1ptp4l0-21swapper/221:58:342
117691450,1ptp4l0-21swapper/100:29:241
1786099446,6cyclictest9-21ksoftirqd/022:00:290
1786099443,6cyclictest9-21ksoftirqd/021:20:270
17860994434,3cyclictest9-21ksoftirqd/021:55:220
1786099442,3cyclictest121rcu_preempt22:30:340
117691440,8ptp4l0-21swapper/022:37:500
117691440,5ptp4l3690-21tune2fs22:05:203
117691440,4ptp4l22762-21/usr/sbin/munin19:20:252
117691440,2ptp4l0-21swapper/121:01:381
117691440,2ptp4l0-21swapper/022:20:430
117691440,1ptp4l0-21swapper/221:52:252
117691440,1ptp4l0-21swapper/221:52:242
117691440,1ptp4l0-21swapper/219:19:052
1786399430,6cyclictest1560-21apt-get23:10:173
117691430,6ptp4l26385-21phc2sys-jitter19:25:373
117691430,5ptp4l27805-21unixbench_multi21:45:353
117691430,5ptp4l27805-21unixbench_multi21:45:353
117691430,2ptp4l0-21swapper/319:55:493
117691430,2ptp4l0-21swapper/220:35:252
117691430,1ptp4l0-21swapper/320:38:383
117691420,5ptp4l41-21ksoftirqd/321:15:333
117691420,5ptp4l23923-21ntp_states19:20:281
117691420,3ptp4l30597-21apt-get20:45:163
117691420,2ptp4l0-21swapper/323:00:493
117691420,2ptp4l0-21swapper/323:00:483
117691420,2ptp4l0-21swapper/322:25:273
117691420,2ptp4l0-21swapper/320:34:063
117691420,2ptp4l0-21swapper/320:23:363
117691420,2ptp4l0-21swapper/319:34:223
117691420,2ptp4l0-21swapper/121:20:561
117691420,1ptp4l0-21swapper/320:16:233
1786399410,4cyclictest2856-21fschecks_time19:45:213
117691410,5ptp4l22105-21ntp_states20:25:332
117691410,5ptp4l11019-21users20:00:361
117691410,4ptp4l41-21ksoftirqd/322:00:193
117691410,4ptp4l30784-21meminfo19:35:283
117691410,4ptp4l20284-21apt-get19:15:183
117691410,4ptp4l14020-21apt-get20:10:183
117691410,4ptp4l12545-21apt-get22:25:201
117691410,4ptp4l11696-21apt-get20:05:153
117691410,2ptp4l0-21swapper/221:03:522
117691410,1ptp4l0-21swapper/321:09:063
117691410,1ptp4l0-21swapper/320:55:093
117691410,1ptp4l0-21swapper/122:06:481
1786399400,4cyclictest25809-21fschecks_count00:00:213
1786399400,4cyclictest117791getstats22:20:213
117691400,5ptp4l18890-21sed23:45:213
117691400,5ptp4l10624-21apt-get23:30:043
117691400,5ptp4l1033-21meminfo00:15:251
117691400,5ptp4l1033-21meminfo00:15:241
117691400,4ptp4l8274-21ntp_states00:30:291
117691400,4ptp4l484-21hddtemp_smartct19:40:251
117691400,4ptp4l28377-21iostat_ios00:05:231
117691400,4ptp4l20567-21df19:15:201
117691400,4ptp4l20271-21ntp_states21:30:303
117691400,4ptp4l19529-21apt-get22:40:163
117691400,4ptp4l18733-21diskstats23:45:191
117691400,3ptp4l25-21ksoftirqd/119:45:421
117691400,2ptp4l0-21swapper/121:05:291
117691400,2ptp4l0-21swapper/119:32:211
117691400,1ptp4l0-21swapper/321:37:353
1786399391,4cyclictest117691ptp4l21:25:313
117691390,5ptp4l31545-21python00:10:313
117691390,5ptp4l22324-21munin-node23:05:333
117691390,5ptp4l13632-21ntp_states22:25:342
117691390,5ptp4l1142-21runrttasks00:37:343
117691390,4ptp4l7963-21tr22:15:133
117691390,4ptp4l29139-21if_enp1s021:50:203
117691390,4ptp4l29139-21if_enp1s021:50:193
117691390,4ptp4l21760-21ntp_states23:50:333
117691390,4ptp4l19905-21df_inode22:40:191
117691390,3ptp4l3447-21ls00:20:253
117691390,2ptp4l0-21swapper/323:30:013
117691390,2ptp4l0-21swapper/119:55:401
117691390,2ptp4l0-21swapper/100:10:261
117691390,1ptp4l0-21swapper/323:17:323
117691380,5ptp4l673-21basename00:15:213
117691380,5ptp4l673-21basename00:15:203
117691380,4ptp4l14988-21python23:35:321
117691380,3ptp4l0-21swapper/322:10:153
117691380,2ptp4l0-21swapper/322:50:303
117691380,2ptp4l0-21swapper/122:50:211
117691380,2ptp4l0-21swapper/121:25:351
1786399370,4cyclictest14484-21acpi21:20:183
117691370,2ptp4l0-21swapper/323:57:593
117691370,2ptp4l0-21swapper/321:40:293
117691370,2ptp4l0-21swapper/321:10:263
117691370,2ptp4l0-21swapper/320:26:453
117691370,2ptp4l0-21swapper/123:55:541
117691370,2ptp4l0-21swapper/123:25:161
117691370,2ptp4l0-21swapper/121:37:411
117691370,2ptp4l0-21swapper/120:56:411
117691370,2ptp4l0-21swapper/120:45:301
117691370,2ptp4l0-21swapper/120:35:211
117691370,2ptp4l0-21swapper/120:15:151
117691370,2ptp4l0-21swapper/119:37:041
17861993629,4cyclictest25-21ksoftirqd/120:50:161
117691360,2ptp4l0-21swapper/123:15:281
117691360,2ptp4l0-21swapper/122:57:261
117691360,2ptp4l0-21swapper/122:57:251
117691360,2ptp4l0-21swapper/122:49:081
117691360,2ptp4l0-21swapper/122:38:441
117691360,2ptp4l0-21swapper/122:21:361
117691360,2ptp4l0-21swapper/122:00:141
117691360,2ptp4l0-21swapper/121:42:591
117691360,2ptp4l0-21swapper/120:42:421
117691360,2ptp4l0-21swapper/120:10:341
117691360,2ptp4l0-21swapper/100:37:271
117691360,2ptp4l0-21swapper/100:02:591
117691360,1ptp4l0-21swapper/121:30:151
117691360,1ptp4l0-21swapper/121:10:021
117691350,2ptp4l0-21swapper/123:50:191
117691350,2ptp4l0-21swapper/122:30:411
117691350,1ptp4l0-21swapper/123:14:361
117691350,1ptp4l0-21swapper/122:16:391
117691350,1ptp4l0-21swapper/121:57:291
117691350,1ptp4l0-21swapper/121:45:151
117691350,1ptp4l0-21swapper/121:45:151
117691350,1ptp4l0-21swapper/120:31:521
117691340,2ptp4l0-21swapper/123:42:231
117691340,1ptp4l0-21swapper/120:26:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional