You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-09-30 - 17:06
/usr/bin/Xorg /usr/bin/Xorg

x86 Intel Atom E3845 @1910 MHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot4.osadl.org (updated Fri Sep 30, 2022 12:46:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1299912120,38ptp4l401ktimersoftd/307:06:353
1034421710,6sleep2249599cyclictest08:35:152
1360821590,7sleep2249599cyclictest11:00:142
297621560,7sleep2249599cyclictest11:45:222
17602132111,9sleep00-21swapper/007:06:530
16942809,59sleep10-21swapper/107:06:011
129991620,1ptp4l401ktimersoftd/309:45:253
129991620,1ptp4l401ktimersoftd/309:41:103
129991610,1ptp4l401ktimersoftd/312:22:173
129991610,1ptp4l401ktimersoftd/311:53:393
129991600,1ptp4l401ktimersoftd/311:01:313
129991600,1ptp4l401ktimersoftd/309:07:593
129991600,1ptp4l401ktimersoftd/308:00:523
129991600,1ptp4l401ktimersoftd/307:15:113
129991580,1ptp4l401ktimersoftd/311:28:513
129991580,1ptp4l401ktimersoftd/310:38:203
292252550,2sleep20-21swapper/208:05:212
2494995523,4cyclictest25-21ksoftirqd/111:20:001
2494995523,4cyclictest25-21ksoftirqd/111:19:591
2493995549,3cyclictest9-21ksoftirqd/012:40:000
249399534,4cyclictest121rcu_preempt09:00:270
249399521,5cyclictest9-21ksoftirqd/008:20:000
249399521,5cyclictest9-21ksoftirqd/008:20:000
2495995143,5cyclictest33-21ksoftirqd/208:55:152
298662500,5sleep029870-21cpuspeed_turbos11:35:140
2494995043,4cyclictest25-21ksoftirqd/107:20:001
2493995044,3cyclictest9-21ksoftirqd/010:00:000
2494994943,3cyclictest25-21ksoftirqd/109:30:001
2493994942,4cyclictest9-21ksoftirqd/007:20:000
2495994841,4cyclictest33-21ksoftirqd/212:20:002
2495994833,12cyclictest33-21ksoftirqd/208:20:002
2495994833,12cyclictest33-21ksoftirqd/208:20:002
2494994842,3cyclictest25-21ksoftirqd/107:40:011
180224816,20sleep20-21swapper/207:07:262
2494994742,3cyclictest25-21ksoftirqd/108:34:591
2494994741,3cyclictest25-21ksoftirqd/111:45:001
249499471,4cyclictest121rcu_preempt08:25:171
249399476,4cyclictest121rcu_preempt10:10:150
2493994741,4cyclictest9-21ksoftirqd/011:30:210
2493994740,4cyclictest9-21ksoftirqd/009:55:000
2493994740,4cyclictest9-21ksoftirqd/009:55:000
1298914738,4phc2sys41-21ksoftirqd/309:30:203
2494994640,4cyclictest25-21ksoftirqd/111:00:001
2494994625,10cyclictest25-21ksoftirqd/111:25:201
2493994640,3cyclictest9-21ksoftirqd/009:15:000
2493994635,6cyclictest9-21ksoftirqd/012:10:150
129991460,1ptp4l401ktimersoftd/307:32:593
32972450,3sleep20-21swapper/210:35:302
2495994536,4cyclictest33-21ksoftirqd/208:25:112
2495994529,5cyclictest33-21ksoftirqd/211:20:002
2495994529,5cyclictest33-21ksoftirqd/211:20:002
249499455,4cyclictest121rcu_preempt07:20:331
2494994540,3cyclictest25-21ksoftirqd/109:35:001
2494994540,3cyclictest25-21ksoftirqd/108:15:291
2494994540,3cyclictest25-21ksoftirqd/108:15:291
2494994539,3cyclictest25-21ksoftirqd/109:15:001
2494994538,4cyclictest25-21ksoftirqd/109:40:161
2494994525,4cyclictest25-21ksoftirqd/108:40:001
2493994539,4cyclictest9-21ksoftirqd/011:00:270
2493994538,4cyclictest9-21ksoftirqd/012:20:110
249399451,9cyclictest121rcu_preempt08:55:010
56498440,13rtkit-daemon0-21swapper/310:40:073
2495994437,4cyclictest33-21ksoftirqd/208:15:002
2495994436,4cyclictest33-21ksoftirqd/209:22:542
249599442,38cyclictest17179-21sh10:00:002
2494994439,3cyclictest25-21ksoftirqd/108:25:001
2494994439,3cyclictest25-21ksoftirqd/108:25:001
2494994438,4cyclictest25-21ksoftirqd/112:40:001
2494994438,4cyclictest25-21ksoftirqd/110:20:011
2494994438,3cyclictest25-21ksoftirqd/111:20:201
2494994438,3cyclictest25-21ksoftirqd/111:20:201
2494994438,3cyclictest25-21ksoftirqd/108:45:011
2494994438,3cyclictest25-21ksoftirqd/108:15:001
2494994437,4cyclictest25-21ksoftirqd/112:30:131
2494994437,4cyclictest25-21ksoftirqd/112:25:141
2494994437,4cyclictest25-21ksoftirqd/108:45:211
2494994437,4cyclictest25-21ksoftirqd/107:40:241
249499441,4cyclictest121rcu_preempt10:00:001
249399444,4cyclictest121rcu_preempt12:20:010
2493994439,3cyclictest9-21ksoftirqd/012:35:000
2493994438,4cyclictest9-21ksoftirqd/010:10:010
2493994438,4cyclictest9-21ksoftirqd/008:40:000
2493994438,4cyclictest9-21ksoftirqd/008:05:190
2493994438,3cyclictest9-21ksoftirqd/012:05:140
249399443,4cyclictest121rcu_preempt10:25:010
249399442,4cyclictest121rcu_preempt10:35:140
129991440,1ptp4l401ktimersoftd/311:30:313
2495994337,4cyclictest33-21ksoftirqd/207:38:382
2495994337,3cyclictest33-21ksoftirqd/212:40:002
2495994336,4cyclictest33-21ksoftirqd/207:30:192
2494994338,3cyclictest25-21ksoftirqd/109:00:001
2494994337,4cyclictest25-21ksoftirqd/111:10:001
2494994337,4cyclictest25-21ksoftirqd/109:10:001
2494994337,3cyclictest25-21ksoftirqd/112:05:151
2494994337,3cyclictest25-21ksoftirqd/109:50:001
2494994336,4cyclictest1330-21cron10:35:011
2494994335,5cyclictest25-21ksoftirqd/107:10:561
2494994333,5cyclictest25-21ksoftirqd/107:50:101
2494994327,4cyclictest25-21ksoftirqd/110:10:001
2493994338,3cyclictest9-21ksoftirqd/010:15:050
2493994338,3cyclictest111rcuc/011:20:000
2493994338,3cyclictest111rcuc/011:19:590
2493994337,3cyclictest9-21ksoftirqd/007:30:010
2493994336,4cyclictest9-21ksoftirqd/010:55:310
2493994336,4cyclictest9-21ksoftirqd/007:45:220
2493994335,5cyclictest9-21ksoftirqd/011:25:000
2493994335,5cyclictest9-21ksoftirqd/011:25:000
2493994332,6cyclictest9-21ksoftirqd/010:45:130
249399431,3cyclictest121rcu_preempt10:50:270
129991430,1ptp4l401ktimersoftd/308:30:173
56498420,2rtkit-daemon563-21rtkit-daemon10:31:283
2495994236,4cyclictest33-21ksoftirqd/207:13:462
2495994236,3cyclictest33-21ksoftirqd/207:55:002
2495994235,4cyclictest33-21ksoftirqd/211:59:262
2494994237,3cyclictest25-21ksoftirqd/110:04:351
2494994236,3cyclictest25-21ksoftirqd/110:45:201
2494994235,4cyclictest25-21ksoftirqd/112:00:011
2494994223,4cyclictest25-21ksoftirqd/110:55:001
2494994223,4cyclictest25-21ksoftirqd/107:45:301
2494994223,4cyclictest25-21ksoftirqd/107:30:221
2493994236,4cyclictest9-21ksoftirqd/009:40:000
2493994236,3cyclictest9-21ksoftirqd/010:25:120
2493994235,4cyclictest9-21ksoftirqd/009:20:110
2493994234,4cyclictest9-21ksoftirqd/008:35:010
249399422,4cyclictest121rcu_preempt09:05:160
249399420,4cyclictest121rcu_preempt08:25:010
129991420,1ptp4l401ktimersoftd/308:36:583
2496994134,4cyclictest41-21ksoftirqd/310:56:303
2494994136,3cyclictest25-21ksoftirqd/111:40:001
2494994135,4cyclictest25-21ksoftirqd/110:10:311
2494994135,3cyclictest25-21ksoftirqd/111:05:001
2494994135,3cyclictest25-21ksoftirqd/108:50:301
2494994134,4cyclictest25-21ksoftirqd/111:30:211
2494994134,4cyclictest25-21ksoftirqd/110:25:011
2494994133,5cyclictest25-21ksoftirqd/109:00:171
2494994122,4cyclictest25-21ksoftirqd/109:24:591
2493994136,3cyclictest9-21ksoftirqd/007:55:000
2493994136,3cyclictest111rcuc/008:25:000
2493994135,4cyclictest9-21ksoftirqd/011:40:210
2493994135,4cyclictest9-21ksoftirqd/009:30:500
2493994135,3cyclictest9-21ksoftirqd/010:00:310
2493994135,3cyclictest9-21ksoftirqd/008:10:220
2493994134,4cyclictest9-21ksoftirqd/011:45:200
2493994134,4cyclictest9-21ksoftirqd/010:35:000
2493994133,4cyclictest9-21ksoftirqd/007:20:260
2493994123,4cyclictest9-21ksoftirqd/009:25:120
129991410,1ptp4l401ktimersoftd/307:24:563
2496994034,4cyclictest41-21ksoftirqd/311:19:353
2496994034,4cyclictest41-21ksoftirqd/311:19:353
2496994033,4cyclictest41-21ksoftirqd/311:43:593
2496994033,4cyclictest41-21ksoftirqd/310:09:313
2495994033,5cyclictest33-21ksoftirqd/208:24:462
2495994033,5cyclictest33-21ksoftirqd/208:24:462
2495994032,6cyclictest33-21ksoftirqd/210:40:182
2495994030,6cyclictest33-21ksoftirqd/211:50:122
2495994029,7cyclictest33-21ksoftirqd/210:25:132
2495994017,9cyclictest33-21ksoftirqd/209:00:272
2494994035,3cyclictest25-21ksoftirqd/111:10:281
2494994034,4cyclictest25-21ksoftirqd/108:00:131
2494994034,3cyclictest25-21ksoftirqd/111:50:141
2494994033,4cyclictest25-21ksoftirqd/112:18:551
2494994033,4cyclictest25-21ksoftirqd/108:08:311
2493994035,3cyclictest9-21ksoftirqd/007:40:540
2493994035,3cyclictest9-21ksoftirqd/007:11:200
249399403,4cyclictest9-21ksoftirqd/008:50:000
2493994034,4cyclictest9-21ksoftirqd/011:55:190
2493994034,3cyclictest9-21ksoftirqd/007:30:060
2493994033,4cyclictest9-21ksoftirqd/012:25:280
2493994032,5cyclictest9-21ksoftirqd/011:28:460
249399402,4cyclictest121rcu_preempt09:40:150
2493994024,4cyclictest9-21ksoftirqd/007:55:250
2493994021,4cyclictest9-21ksoftirqd/011:05:210
2493994020,5cyclictest9-21ksoftirqd/011:50:250
2496993932,4cyclictest41-21ksoftirqd/311:47:263
2496993932,4cyclictest41-21ksoftirqd/309:53:283
2496993932,4cyclictest41-21ksoftirqd/309:53:283
2496993932,4cyclictest41-21ksoftirqd/308:15:503
2496993932,4cyclictest41-21ksoftirqd/308:15:493
2496993932,4cyclictest41-21ksoftirqd/307:46:553
2495993933,4cyclictest33-21ksoftirqd/210:13:462
2495993933,3cyclictest33-21ksoftirqd/212:04:012
2495993932,4cyclictest33-21ksoftirqd/211:24:192
2495993932,4cyclictest33-21ksoftirqd/211:24:182
2495993932,4cyclictest33-21ksoftirqd/211:08:272
2495993932,4cyclictest33-21ksoftirqd/209:47:412
2495993928,7cyclictest33-21ksoftirqd/207:55:112
2495993925,11cyclictest33-21ksoftirqd/210:05:002
249599391,4cyclictest121rcu_preempt11:34:192
2494993933,4cyclictest25-21ksoftirqd/112:20:461
2494993933,3cyclictest25-21ksoftirqd/112:10:321
2494993932,4cyclictest25-21ksoftirqd/111:45:011
2494993932,4cyclictest25-21ksoftirqd/109:52:201
2494993932,4cyclictest25-21ksoftirqd/109:52:201
2494993932,4cyclictest25-21ksoftirqd/107:27:131
2494993931,5cyclictest25-21ksoftirqd/110:27:431
2494993923,4cyclictest25-21ksoftirqd/110:35:121
249499390,4cyclictest121rcu_preempt10:40:271
2493993933,3cyclictest9-21ksoftirqd/009:15:280
2493993932,4cyclictest9-21ksoftirqd/011:10:290
2493993932,3cyclictest9-21ksoftirqd/008:30:010
2493993921,4cyclictest9-21ksoftirqd/008:40:150
129991390,1ptp4l401ktimersoftd/312:29:093
129991390,17ptp4l401ktimersoftd/310:00:383
2496993833,3cyclictest41-21ksoftirqd/311:35:453
2496993833,3cyclictest41-21ksoftirqd/309:16:163
2496993832,3cyclictest41-21ksoftirqd/307:12:013
2496993831,4cyclictest41-21ksoftirqd/312:30:073
2496993831,4cyclictest41-21ksoftirqd/311:24:283
2496993831,4cyclictest41-21ksoftirqd/311:24:283
2496993831,4cyclictest41-21ksoftirqd/310:45:063
2496993831,4cyclictest41-21ksoftirqd/309:04:143
2496993831,4cyclictest41-21ksoftirqd/308:46:353
2496993831,4cyclictest41-21ksoftirqd/307:27:423
2495993833,3cyclictest33-21ksoftirqd/207:46:312
2495993832,4cyclictest33-21ksoftirqd/209:25:272
2495993832,4cyclictest33-21ksoftirqd/207:41:462
2495993831,4cyclictest33-21ksoftirqd/212:30:092
2495993831,4cyclictest33-21ksoftirqd/212:25:002
2495993831,4cyclictest33-21ksoftirqd/210:53:242
2495993831,4cyclictest33-21ksoftirqd/209:11:472
2494993831,4cyclictest25-21ksoftirqd/109:35:191
2494993822,4cyclictest25-21ksoftirqd/109:15:141
2494993819,4cyclictest25-21ksoftirqd/107:55:261
2493993832,4cyclictest9-21ksoftirqd/012:00:430
2493993831,4cyclictest9-21ksoftirqd/009:50:000
2493993831,4cyclictest9-21ksoftirqd/008:55:310
2493993831,4cyclictest9-21ksoftirqd/007:35:490
249399380,4cyclictest121rcu_preempt10:40:170
129991380,13ptp4l0-21swapper/310:15:203
129991380,13ptp4l0-21swapper/308:52:563
2496993732,3cyclictest209-21systemd-journal08:09:553
2496993731,4cyclictest41-21ksoftirqd/310:26:233
2496993731,3cyclictest41-21ksoftirqd/311:58:133
2496993730,4cyclictest41-21ksoftirqd/312:17:563
2496993730,4cyclictest41-21ksoftirqd/309:37:343
2496993730,4cyclictest41-21ksoftirqd/308:56:193
2496993730,4cyclictest41-21ksoftirqd/307:39:253
2495993731,4cyclictest33-21ksoftirqd/210:15:222
2495993731,3cyclictest33-21ksoftirqd/209:50:182
2495993731,3cyclictest33-21ksoftirqd/209:50:182
2495993731,3cyclictest33-21ksoftirqd/209:37:482
2495993730,4cyclictest33-21ksoftirqd/210:34:052
2494993721,4cyclictest25-21ksoftirqd/112:00:181
2493993732,3cyclictest9-21ksoftirqd/008:00:020
129991370,1ptp4l401ktimersoftd/309:25:163
129991370,1ptp4l401ktimersoftd/308:20:133
129991370,1ptp4l401ktimersoftd/308:20:133
129991370,12ptp4l0-21swapper/308:12:533
2496993631,3cyclictest41-21ksoftirqd/309:58:303
2496993629,4cyclictest41-21ksoftirqd/312:35:373
2496993629,4cyclictest41-21ksoftirqd/312:13:343
2496993629,4cyclictest41-21ksoftirqd/310:11:103
2495993630,3cyclictest33-21ksoftirqd/209:07:442
2495993629,4cyclictest33-21ksoftirqd/211:14:222
2495993629,4cyclictest33-21ksoftirqd/210:56:502
2495993622,9cyclictest33-21ksoftirqd/208:00:102
2495993622,8cyclictest33-21ksoftirqd/207:20:142
129991360,1ptp4l401ktimersoftd/311:05:283
129991360,1ptp4l401ktimersoftd/309:20:143
129991360,1ptp4l401ktimersoftd/308:44:073
2496993529,3cyclictest41-21ksoftirqd/310:21:593
2496993528,4cyclictest41-21ksoftirqd/307:41:413
2496993527,5cyclictest41-21ksoftirqd/308:25:043
2495993529,4cyclictest33-21ksoftirqd/211:37:362
2495993529,3cyclictest33-21ksoftirqd/211:30:012
2495993529,3cyclictest33-21ksoftirqd/210:50:012
2495993529,3cyclictest33-21ksoftirqd/208:31:452
2495993528,4cyclictest33-21ksoftirqd/209:30:142
2495993528,4cyclictest33-21ksoftirqd/208:49:192
2495993528,4cyclictest33-21ksoftirqd/207:28:032
2496993428,4cyclictest41-21ksoftirqd/307:56:133
2496993427,4cyclictest41-21ksoftirqd/312:07:233
2496993427,4cyclictest41-21ksoftirqd/311:10:453
2495993427,4cyclictest33-21ksoftirqd/207:19:402
2495993426,5cyclictest33-21ksoftirqd/210:08:032
129991340,1ptp4l401ktimersoftd/307:51:413
2495993328,3cyclictest33-21ksoftirqd/208:50:302
2495993327,3cyclictest33-21ksoftirqd/211:41:332
2495993327,3cyclictest33-21ksoftirqd/208:42:572
2495993326,4cyclictest33-21ksoftirqd/212:13:442
2495993326,4cyclictest33-21ksoftirqd/212:10:002
2495993326,4cyclictest33-21ksoftirqd/209:40:022
2496993225,4cyclictest41-21ksoftirqd/312:04:153
2496993225,4cyclictest41-21ksoftirqd/309:12:173
2495993226,4cyclictest33-21ksoftirqd/212:20:202
2495993211,10cyclictest33-21ksoftirqd/210:25:002
2495993125,3cyclictest33-21ksoftirqd/209:20:002
2496993024,4cyclictest41-21ksoftirqd/310:50:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional