You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-09 - 03:23

x86 Intel Atom E3845 @1910 MHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot1.osadl.org (updated Thu Jun 08, 2023 12:46:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2152721750,9sleep0589499cyclictest12:20:240
1176911630,15ptp4l0-21swapper/007:06:390
1176911600,67ptp4l0-21swapper/107:09:021
3091821430,7sleep1589599cyclictest08:01:011
3091821430,7sleep1589599cyclictest08:01:001
2673321420,8sleep3589799cyclictest07:54:593
1176911330,10ptp4l0-21swapper/207:08:552
1176911150,7ptp4l0-21swapper/307:05:463
194372960,56sleep241850irq/95-enp4s0-T11:05:322
117691940,38ptp4l9-21ksoftirqd/011:25:290
85792780,6sleep3589799cyclictest08:25:203
5896997425,10cyclictest33-21ksoftirqd/209:50:222
5896997218,10cyclictest33-21ksoftirqd/210:30:312
5896997119,10cyclictest33-21ksoftirqd/211:45:342
42212710,7sleep30-21swapper/310:35:003
5896997020,10cyclictest33-21ksoftirqd/210:20:312
5896997018,11cyclictest33-21ksoftirqd/208:25:512
5896997017,11cyclictest33-21ksoftirqd/211:29:522
5896996923,10cyclictest33-21ksoftirqd/209:05:422
5896996920,10cyclictest33-21ksoftirqd/207:10:312
5896996918,5cyclictest33-21ksoftirqd/210:00:412
5896996918,5cyclictest33-21ksoftirqd/210:00:412
5896996917,11cyclictest33-21ksoftirqd/208:19:312
5896996825,10cyclictest33-21ksoftirqd/212:35:202
5896996822,10cyclictest33-21ksoftirqd/207:35:392
5896996821,13cyclictest33-21ksoftirqd/210:35:242
5896996821,11cyclictest33-21ksoftirqd/210:15:442
5896996820,11cyclictest33-21ksoftirqd/208:30:222
5896996725,4cyclictest33-21ksoftirqd/207:20:262
5896996720,11cyclictest33-21ksoftirqd/212:10:362
5896996719,10cyclictest33-21ksoftirqd/212:20:312
5896996718,5cyclictest33-21ksoftirqd/212:25:262
5896996625,11cyclictest33-21ksoftirqd/209:35:332
5896996622,4cyclictest33-21ksoftirqd/211:15:012
5896996622,10cyclictest33-21ksoftirqd/212:20:002
5896996621,8cyclictest33-21ksoftirqd/209:00:502
5896996621,8cyclictest33-21ksoftirqd/209:00:492
5896996621,5cyclictest33-21ksoftirqd/209:20:392
5896996620,9cyclictest33-21ksoftirqd/210:45:292
5896996620,5cyclictest33-21ksoftirqd/211:30:352
5896996620,10cyclictest33-21ksoftirqd/211:15:262
5896996619,10cyclictest33-21ksoftirqd/210:40:332
5896996618,10cyclictest33-21ksoftirqd/210:10:452
5896996618,10cyclictest33-21ksoftirqd/209:57:512
5896996618,10cyclictest33-21ksoftirqd/209:25:492
117691660,4ptp4l1185-21lldpd11:59:433
117691660,4ptp4l1185-21lldpd11:59:433
117691660,22ptp4l1185-21lldpd12:10:163
5896996521,5cyclictest33-21ksoftirqd/211:55:002
5896996519,5cyclictest33-21ksoftirqd/208:00:462
5896996519,5cyclictest33-21ksoftirqd/208:00:452
5896996519,10cyclictest33-21ksoftirqd/207:25:282
5896996518,9cyclictest33-21ksoftirqd/212:30:222
5896996518,10cyclictest33-21ksoftirqd/208:45:522
5896996515,5cyclictest33-21ksoftirqd/209:30:442
5896996514,5cyclictest33-21ksoftirqd/210:25:172
5895996526,13cyclictest25-21ksoftirqd/108:50:491
5894996526,4cyclictest9-21ksoftirqd/008:00:490
5894996526,4cyclictest9-21ksoftirqd/008:00:490
119552650,5sleep341-21ksoftirqd/310:50:223
117691650,5ptp4l1185-21lldpd09:14:233
117691650,4ptp4l1185-21lldpd09:01:173
117691650,4ptp4l1185-21lldpd09:01:173
117691650,13ptp4l25-21ksoftirqd/110:33:171
5896996423,10cyclictest33-21ksoftirqd/208:40:412
5896996420,5cyclictest33-21ksoftirqd/211:00:252
5896996420,5cyclictest33-21ksoftirqd/211:00:242
5896996420,5cyclictest33-21ksoftirqd/210:50:172
5896996419,10cyclictest33-21ksoftirqd/208:10:362
5896996418,10cyclictest33-21ksoftirqd/209:15:352
5896996418,10cyclictest33-21ksoftirqd/207:55:202
5896996418,10cyclictest33-21ksoftirqd/207:30:292
5896996417,9cyclictest33-21ksoftirqd/208:35:342
5896996417,11cyclictest33-21ksoftirqd/207:45:362
5896996415,10cyclictest33-21ksoftirqd/208:05:362
5895996427,16cyclictest25-21ksoftirqd/109:50:371
5894996427,10cyclictest9-21ksoftirqd/010:15:360
5894996425,5cyclictest9-21ksoftirqd/012:35:440
117691640,6ptp4l1185-21lldpd10:47:273
117691640,5ptp4l1185-21lldpd09:31:313
117691640,5ptp4l1185-21lldpd09:26:143
117691640,5ptp4l1185-21lldpd08:41:133
117691640,4ptp4l22200-21cut07:45:001
117691640,4ptp4l1159-21snmpd12:04:053
5896996322,5cyclictest33-21ksoftirqd/211:35:292
5896996321,9cyclictest33-21ksoftirqd/211:20:362
5896996320,11cyclictest33-21ksoftirqd/211:40:232
5896996318,11cyclictest33-21ksoftirqd/207:44:152
5896996318,10cyclictest33-21ksoftirqd/209:10:362
5896996317,8cyclictest33-21ksoftirqd/210:05:512
5895996325,13cyclictest25-21ksoftirqd/109:05:551
5895996324,15cyclictest25-21ksoftirqd/108:25:011
117691630,6ptp4l1159-21snmpd07:39:473
117691630,5ptp4l1185-21lldpd12:18:053
117691630,4ptp4l1185-21lldpd12:07:202
117691630,4ptp4l1185-21lldpd10:20:143
117691630,4ptp4l1185-21lldpd09:40:222
5896996224,11cyclictest33-21ksoftirqd/208:50:202
5896996221,5cyclictest33-21ksoftirqd/207:50:232
5896996220,8cyclictest33-21ksoftirqd/207:15:242
5896996217,5cyclictest33-21ksoftirqd/209:45:452
5896996217,10cyclictest33-21ksoftirqd/212:00:342
5895996228,8cyclictest25-21ksoftirqd/109:40:271
5895996223,4cyclictest25-21ksoftirqd/111:30:001
117691620,5ptp4l1185-21lldpd11:41:073
117691620,5ptp4l1185-21lldpd08:20:402
117691620,4ptp4l1185-21lldpd10:09:593
117691620,4ptp4l1185-21lldpd09:24:293
5896996120,5cyclictest33-21ksoftirqd/210:55:332
5896996115,9cyclictest33-21ksoftirqd/211:55:222
5896996115,9cyclictest33-21ksoftirqd/211:55:212
5895996128,3cyclictest25-21ksoftirqd/109:56:111
5895996125,9cyclictest25-21ksoftirqd/108:15:011
5895996125,7cyclictest25-21ksoftirqd/109:15:341
5895996125,7cyclictest25-21ksoftirqd/108:35:311
5895996119,12cyclictest25-21ksoftirqd/110:10:341
5894996127,9cyclictest9-21ksoftirqd/011:15:230
5894996122,10cyclictest9-21ksoftirqd/008:30:290
117691610,9ptp4l0-21swapper/011:03:130
117691610,9ptp4l0-21swapper/011:03:130
117691610,6ptp4l4815-21rs:main0
117691610,4ptp4l1185-21lldpd11:54:253
117691610,4ptp4l1185-21lldpd09:15:473
117691610,4ptp4l1185-21lldpd08:47:223
117691610,4ptp4l1185-21lldpd08:04:113
117691610,4ptp4l1185-21lldpd08:04:113
117691610,4ptp4l1185-21lldpd07:10:233
5895996026,8cyclictest25-21ksoftirqd/111:05:381
5895996025,8cyclictest25-21ksoftirqd/109:00:261
5895996025,8cyclictest25-21ksoftirqd/109:00:261
5895996025,6cyclictest25-21ksoftirqd/112:20:211
5895996024,10cyclictest25-21ksoftirqd/107:20:271
5895996023,14cyclictest25-21ksoftirqd/111:40:211
5894996023,5cyclictest9-21ksoftirqd/011:35:350
5894996020,10cyclictest9-21ksoftirqd/011:54:300
117691600,8ptp4l1185-21lldpd11:11:363
117691600,4ptp4l216-21systemd-journal12:31:573
117691600,3ptp4l1159-21snmpd08:56:432
117691600,2ptp4l0-21swapper/308:38:293
5895995925,10cyclictest25-21ksoftirqd/108:55:301
5895995924,9cyclictest25-21ksoftirqd/111:35:231
5894995932,3cyclictest9-21ksoftirqd/009:16:420
5894995930,3cyclictest9-21ksoftirqd/009:25:310
5894995929,4cyclictest9-21ksoftirqd/010:30:000
5894995927,5cyclictest9-21ksoftirqd/008:45:440
5894995926,8cyclictest9-21ksoftirqd/007:35:490
5894995925,9cyclictest9-21ksoftirqd/012:30:290
117691590,6ptp4l1159-21snmpd07:55:400
117691590,5ptp4l1185-21lldpd07:19:163
117691590,15ptp4l0-21swapper/311:46:253
117691590,13ptp4l0-21swapper/308:07:533
5895995825,7cyclictest25-21ksoftirqd/107:25:401
5895995825,5cyclictest25-21ksoftirqd/111:00:231
5895995825,5cyclictest25-21ksoftirqd/111:00:221
5895995825,4cyclictest25-21ksoftirqd/111:56:181
5895995825,4cyclictest25-21ksoftirqd/111:56:181
5895995824,9cyclictest25-21ksoftirqd/112:10:241
5895995824,8cyclictest25-21ksoftirqd/107:33:241
5895995823,9cyclictest25-21ksoftirqd/110:25:161
5895995823,9cyclictest25-21ksoftirqd/107:55:351
5895995819,7cyclictest25-21ksoftirqd/109:20:211
5895995818,4cyclictest25-21ksoftirqd/111:10:261
5894995826,8cyclictest9-21ksoftirqd/010:30:220
5894995822,10cyclictest9-21ksoftirqd/007:15:160
5894995818,9cyclictest9-21ksoftirqd/012:04:270
117691580,6ptp4l1185-21lldpd09:14:560
117691580,4ptp4l1185-21lldpd11:34:100
117691580,2ptp4l0-21swapper/311:26:223
117691580,2ptp4l0-21swapper/311:22:503
589599574,4cyclictest121rcu_preempt10:35:241
5895995726,5cyclictest25-21ksoftirqd/107:10:281
5895995724,13cyclictest25-21ksoftirqd/108:40:581
5895995723,9cyclictest25-21ksoftirqd/107:15:361
5895995723,8cyclictest25-21ksoftirqd/112:35:231
5895995723,8cyclictest25-21ksoftirqd/110:20:191
5895995723,8cyclictest25-21ksoftirqd/110:15:401
5895995723,8cyclictest25-21ksoftirqd/109:10:531
5895995722,13cyclictest25-21ksoftirqd/108:45:211
5895995722,10cyclictest25-21ksoftirqd/110:45:331
5895995719,7cyclictest25-21ksoftirqd/109:39:381
5895995716,10cyclictest25-21ksoftirqd/111:30:381
5894995724,4cyclictest9-21ksoftirqd/010:50:190
5894995723,9cyclictest9-21ksoftirqd/008:40:350
117791570,19getstats20752-21perl08:50:290
117691570,5ptp4l1185-21lldpd09:51:313
117691570,4ptp4l1185-21lldpd10:04:443
117691570,4ptp4l1185-21lldpd10:04:433
117691570,4ptp4l1185-21lldpd08:59:090
117691570,3ptp4l4813-21in:imuxsock10:14:530
117691570,14ptp4l0-21swapper/308:54:053
5895995630,4cyclictest25-21ksoftirqd/111:15:401
5895995624,8cyclictest25-21ksoftirqd/110:05:401
5895995624,5cyclictest25-21ksoftirqd/112:25:421
5895995623,9cyclictest25-21ksoftirqd/112:09:541
5895995623,9cyclictest25-21ksoftirqd/110:50:431
5895995622,9cyclictest25-21ksoftirqd/112:00:211
5895995622,7cyclictest25-21ksoftirqd/110:05:001
5895995622,7cyclictest25-21ksoftirqd/110:05:001
5895995621,4cyclictest25-21ksoftirqd/107:35:381
5895995619,9cyclictest25-21ksoftirqd/108:10:001
5894995634,7cyclictest9-21ksoftirqd/007:45:370
5894995625,6cyclictest9-21ksoftirqd/009:45:590
5894995624,9cyclictest9-21ksoftirqd/010:04:070
5894995624,9cyclictest9-21ksoftirqd/010:04:070
117691560,5ptp4l1185-21lldpd10:36:513
117691560,5ptp4l1185-21lldpd10:26:153
117691560,4ptp4l1185-21lldpd07:45:513
117691560,2ptp4l0-21swapper/012:27:190
117691560,2ptp4l0-21swapper/009:51:480
117691560,2ptp4l0-21swapper/009:44:260
117691560,2ptp4l0-21swapper/009:21:330
117691560,2ptp4l0-21swapper/007:52:420
5895995522,7cyclictest25-21ksoftirqd/107:54:591
5895995517,4cyclictest25-21ksoftirqd/109:35:021
5894995524,8cyclictest9-21ksoftirqd/010:45:300
5894995523,9cyclictest9-21ksoftirqd/011:20:400
5894995523,8cyclictest9-21ksoftirqd/008:38:190
117691550,6ptp4l1185-21lldpd11:08:053
117691550,5ptp4l1185-21lldpd09:47:043
117691550,5ptp4l1185-21lldpd07:59:003
117691550,4ptp4l1185-21lldpd07:28:363
117691550,4ptp4l1159-21snmpd11:04:023
117691550,4ptp4l1159-21snmpd11:04:023
117691550,2ptp4l0-21swapper/011:40:330
117691550,2ptp4l0-21swapper/009:38:130
117691550,2ptp4l0-21swapper/007:44:540
117691550,2ptp4l0-21swapper/007:24:510
5895995424,4cyclictest25-21ksoftirqd/111:20:301
5895995423,7cyclictest25-21ksoftirqd/108:25:211
5895995423,4cyclictest25-21ksoftirqd/112:32:591
5895995421,8cyclictest25-21ksoftirqd/111:45:211
5895995419,8cyclictest25-21ksoftirqd/111:00:001
5894995426,5cyclictest9-21ksoftirqd/009:00:350
5894995426,5cyclictest9-21ksoftirqd/009:00:350
5894995423,8cyclictest9-21ksoftirqd/012:05:010
5894995423,8cyclictest9-21ksoftirqd/010:56:550
117691540,4ptp4l1185-21lldpd11:30:423
117691540,3ptp4l216-21systemd-journal10:36:270
117691540,3ptp4l1185-21lldpd12:11:410
117691540,2ptp4l0-21swapper/010:21:530
117691540,2ptp4l0-21swapper/009:56:000
5895995317,4cyclictest25-21ksoftirqd/108:15:381
117691530,5ptp4l1185-21lldpd08:57:493
117691530,3ptp4l1185-21lldpd07:33:023
117691530,2ptp4l0-21swapper/311:16:383
117691530,2ptp4l0-21swapper/012:16:260
117691530,2ptp4l0-21swapper/011:58:030
117691530,2ptp4l0-21swapper/011:58:030
117691530,2ptp4l0-21swapper/008:23:450
117691530,2ptp4l0-21swapper/008:17:300
117691530,2ptp4l0-21swapper/007:31:460
5897995218,4cyclictest41-21ksoftirqd/312:20:303
589799520,6cyclictest41-21ksoftirqd/309:40:013
5895995220,8cyclictest25-21ksoftirqd/108:30:301
5895995219,8cyclictest25-21ksoftirqd/109:45:471
5895995216,8cyclictest25-21ksoftirqd/107:49:411
5895995214,10cyclictest25-21ksoftirqd/111:50:291
117691520,3ptp4l0-21swapper/308:18:543
117691520,2ptp4l0-21swapper/310:10:163
117691520,2ptp4l0-21swapper/309:38:243
117691520,2ptp4l0-21swapper/011:13:440
117691520,15ptp4l1185-21lldpd08:07:180
589799517,4cyclictest41-21ksoftirqd/310:40:223
5895995118,9cyclictest25-21ksoftirqd/112:15:391
5894995122,11cyclictest9-21ksoftirqd/009:07:470
117691510,2ptp4l0-21swapper/008:11:050
117691510,2ptp4l0-21swapper/007:27:300
117691510,10ptp4l0-21swapper/310:55:583
589799504,7cyclictest121rcu_preempt12:35:193
5897995022,4cyclictest41-21ksoftirqd/310:15:243
5897995020,6cyclictest41-21ksoftirqd/309:58:173
5897995019,5cyclictest41-21ksoftirqd/311:37:203
5895995022,4cyclictest25-21ksoftirqd/109:25:201
5895995018,13cyclictest25-21ksoftirqd/110:41:171
5894995020,10cyclictest9-21ksoftirqd/009:31:240
117691500,2ptp4l0-21swapper/309:05:313
117691500,2ptp4l0-21swapper/307:23:233
117691500,14ptp4l1159-21snmpd08:24:533
5897994919,5cyclictest41-21ksoftirqd/308:13:233
5897994918,5cyclictest41-21ksoftirqd/308:33:413
5894994921,5cyclictest9-21ksoftirqd/011:05:040
5894994918,8cyclictest9-21ksoftirqd/011:48:510
117691490,5ptp4l1185-21lldpd08:25:460
589499486,8cyclictest7469-21ls07:10:400
117691480,2ptp4l0-21swapper/307:43:233
5897994713,3cyclictest117691ptp4l12:29:023
589499464,9cyclictest9-21ksoftirqd/010:05:310
5897994522,4cyclictest41-21ksoftirqd/312:06:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional