You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-22 - 22:27

x86 Intel Atom E3845 @1910 MHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Wed Mar 22, 2023 12:46:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8255911130,5ptp4l401ktimersoftd/307:07:233
3253821100,7sleep2311rcuc/207:05:322
6702804,20sleep10-21swapper/107:09:351
990997871,4cyclictest25-21ksoftirqd/111:45:181
287702770,6sleep098999cyclictest11:35:000
990997635,10cyclictest25-21ksoftirqd/111:25:001
990997569,4cyclictest25-21ksoftirqd/112:20:161
990997569,4cyclictest25-21ksoftirqd/112:20:161
990997265,4cyclictest25-21ksoftirqd/112:00:161
990996937,4cyclictest25-21ksoftirqd/112:10:311
990996835,5cyclictest25-21ksoftirqd/107:45:181
990996828,8cyclictest25-21ksoftirqd/107:10:111
990996737,4cyclictest25-21ksoftirqd/111:00:291
990996729,7cyclictest25-21ksoftirqd/107:50:241
990996729,7cyclictest25-21ksoftirqd/107:50:231
990996658,5cyclictest25-21ksoftirqd/109:20:051
990996630,4cyclictest25-21ksoftirqd/110:00:001
990996629,8cyclictest25-21ksoftirqd/110:34:591
990996628,8cyclictest25-21ksoftirqd/111:05:181
990996627,8cyclictest25-21ksoftirqd/112:25:351
990996627,8cyclictest25-21ksoftirqd/112:25:341
990996627,7cyclictest25-21ksoftirqd/107:25:201
990996558,4cyclictest25-21ksoftirqd/108:15:051
990996558,4cyclictest25-21ksoftirqd/107:55:051
990996558,4cyclictest25-21ksoftirqd/107:55:041
990996557,5cyclictest25-21ksoftirqd/111:25:051
990996540,4cyclictest25-21ksoftirqd/109:45:321
990996529,4cyclictest25-21ksoftirqd/108:35:161
990996457,4cyclictest25-21ksoftirqd/112:35:041
825591640,5ptp4l401ktimersoftd/307:10:013
990996356,4cyclictest25-21ksoftirqd/109:15:041
990996332,5cyclictest25-21ksoftirqd/110:27:371
990996331,8cyclictest25-21ksoftirqd/108:20:421
990996329,8cyclictest25-21ksoftirqd/111:15:291
990996325,8cyclictest25-21ksoftirqd/110:45:291
99099623,8cyclictest25-21ksoftirqd/107:35:271
990996234,8cyclictest25-21ksoftirqd/112:35:011
990996232,4cyclictest25-21ksoftirqd/108:45:271
99099605,7cyclictest25-21ksoftirqd/109:40:001
990996028,9cyclictest25-21ksoftirqd/107:40:241
991995952,4cyclictest33-21ksoftirqd/207:40:192
99099597,4cyclictest25-21ksoftirqd/110:55:381
99099597,4cyclictest25-21ksoftirqd/110:55:381
990995948,4cyclictest25-21ksoftirqd/108:00:281
990995930,8cyclictest25-21ksoftirqd/111:10:141
990995924,8cyclictest25-21ksoftirqd/109:05:161
990995924,5cyclictest25-21ksoftirqd/110:14:321
990995924,3cyclictest121rcu_preempt08:13:521
990995921,8cyclictest25-21ksoftirqd/110:07:371
990995823,6cyclictest25-21ksoftirqd/110:40:331
989995846,6cyclictest9-21ksoftirqd/009:10:120
99099576,4cyclictest25-21ksoftirqd/110:50:351
990995743,4cyclictest25-21ksoftirqd/110:00:181
99099566,8cyclictest25-21ksoftirqd/112:15:271
99099566,3cyclictest25-21ksoftirqd/111:35:391
99099565,8cyclictest121rcu_preempt08:44:591
990995645,3cyclictest25-21ksoftirqd/107:30:301
990995642,4cyclictest25-21ksoftirqd/111:30:271
990995624,10cyclictest25-21ksoftirqd/111:54:591
990995621,4cyclictest25-21ksoftirqd/111:40:581
195462560,2sleep00-21swapper/008:55:360
190222560,3sleep019025-21phc2sys-jitter12:20:290
190222560,3sleep019025-21phc2sys-jitter12:20:290
99099554,9cyclictest25-21ksoftirqd/108:25:191
990995521,8cyclictest25-21ksoftirqd/111:55:321
99099544,4cyclictest25-21ksoftirqd/108:30:241
99099544,4cyclictest17474-21unattended-upgr08:50:331
990995444,3cyclictest25-21ksoftirqd/110:35:301
99099543,4cyclictest5584-21idleruntime-cro07:19:591
99099542,8cyclictest25-21ksoftirqd/109:40:291
99099541,8cyclictest25-21ksoftirqd/109:10:161
290362540,2sleep00-21swapper/011:35:220
99099537,4cyclictest25-21ksoftirqd/107:25:001
99099534,11cyclictest25-21ksoftirqd/109:35:001
990995340,4cyclictest25-21ksoftirqd/110:15:291
99099533,8cyclictest25-21ksoftirqd/109:55:011
99099533,3cyclictest25-21ksoftirqd/110:20:301
99099531,4cyclictest121rcu_preempt09:00:271
99099525,4cyclictest121rcu_preempt08:55:251
99099523,9cyclictest25-21ksoftirqd/108:05:151
34892520,2sleep20-21swapper/211:49:592
992995130,18cyclictest41-21ksoftirqd/309:45:363
99099511,6cyclictest25-21ksoftirqd/109:25:211
99099511,6cyclictest25-21ksoftirqd/109:25:211
992995029,18cyclictest41-21ksoftirqd/311:26:083
990995032,7cyclictest25-21ksoftirqd/112:05:261
57698480,2rtkit-daemon0-21swapper/010:57:250
57698480,2rtkit-daemon0-21swapper/010:57:250
992994625,18cyclictest41-21ksoftirqd/312:25:173
992994625,18cyclictest41-21ksoftirqd/312:25:173
992994522,20cyclictest41-21ksoftirqd/309:42:193
989994539,3cyclictest9-21ksoftirqd/007:40:000
989994438,3cyclictest9-21ksoftirqd/010:00:010
825591440,1ptp4l401ktimersoftd/307:25:243
991994334,5cyclictest33-21ksoftirqd/212:34:592
825591430,1ptp4l401ktimersoftd/308:50:343
3104124313,19sleep00-21swapper/007:05:100
992994214,25cyclictest24851-21/usr/sbin/munin08:00:293
992994214,25cyclictest20789-21sed10:05:413
989994236,4cyclictest9-21ksoftirqd/012:25:280
989994236,4cyclictest9-21ksoftirqd/012:25:280
214942420,2sleep321498-21sed09:00:193
992994135,3cyclictest41-21ksoftirqd/308:44:593
992994119,19cyclictest41-21ksoftirqd/307:19:373
992994113,25cyclictest7912-21phc2sys-jitter08:30:263
992994112,4cyclictest18382-21uniq12:20:223
992994112,4cyclictest18382-21uniq12:20:213
991994136,3cyclictest33-21ksoftirqd/207:15:002
989994136,3cyclictest9-21ksoftirqd/012:30:160
98999412,4cyclictest9-21ksoftirqd/007:55:010
98999412,4cyclictest9-21ksoftirqd/007:55:000
992994033,4cyclictest41-21ksoftirqd/309:35:003
992994013,24cyclictest1100-21runrttasks11:43:323
992994012,25cyclictest25312-21cut09:10:003
992994010,5cyclictest15101-21ls11:05:153
992994010,4cyclictest20983-21ls11:15:323
991994033,4cyclictest33-21ksoftirqd/210:55:012
989994035,3cyclictest9-21ksoftirqd/007:50:000
989994035,3cyclictest9-21ksoftirqd/007:40:280
989994034,4cyclictest9-21ksoftirqd/010:05:000
989994034,4cyclictest9-21ksoftirqd/007:30:140
989994034,3cyclictest9-21ksoftirqd/012:04:590
989994034,3cyclictest9-21ksoftirqd/010:35:290
989994034,3cyclictest9-21ksoftirqd/008:44:590
992993912,4cyclictest28839-21df_abs10:25:213
992993912,4cyclictest25666-21basename12:35:223
992993911,4cyclictest1100-21runrttasks09:15:143
992993910,3cyclictest14725-21wc08:45:243
991993931,5cyclictest33-21ksoftirqd/208:05:002
989993933,4cyclictest9-21ksoftirqd/012:10:010
99299389,5cyclictest11010-21df_abs12:05:173
99299389,4cyclictest3574-21cat08:20:423
99299388,9cyclictest12831-21df_abs11:00:183
992993832,3cyclictest41-21ksoftirqd/312:02:583
992993831,4cyclictest41-21ksoftirqd/310:04:473
992993831,4cyclictest41-21ksoftirqd/308:13:473
992993812,4cyclictest2935-21unixbench_multi11:45:373
992993812,3cyclictest12667-21cut07:34:593
992993811,4cyclictest31629-21cut10:30:243
991993831,4cyclictest33-21ksoftirqd/212:05:572
991993830,5cyclictest33-21ksoftirqd/211:27:092
991993830,5cyclictest33-21ksoftirqd/208:22:462
989993833,3cyclictest9-21ksoftirqd/007:55:310
989993833,3cyclictest9-21ksoftirqd/007:55:300
989993832,3cyclictest9-21ksoftirqd/011:16:070
989993831,4cyclictest9-21ksoftirqd/007:15:230
99299379,4cyclictest5735-21latency_hist11:55:003
99299379,4cyclictest28743-21timerwakeupswit08:05:303
99299378,4cyclictest2624-21latency_hist09:30:003
99299378,4cyclictest2624-21latency_hist09:30:003
99299376,6cyclictest0-21swapper/307:55:373
99299376,6cyclictest0-21swapper/307:55:363
99299373,7cyclictest15202-21apt-get07:40:193
992993730,4cyclictest41-21ksoftirqd/309:51:473
992993711,3cyclictest6514-21sh08:30:003
991993731,4cyclictest33-21ksoftirqd/211:05:122
991993730,4cyclictest33-21ksoftirqd/207:56:022
991993730,4cyclictest33-21ksoftirqd/207:56:022
989993732,3cyclictest9-21ksoftirqd/009:20:000
989993731,4cyclictest9-21ksoftirqd/010:30:170
989993731,4cyclictest9-21ksoftirqd/008:13:320
989993731,3cyclictest9-21ksoftirqd/011:29:240
989993731,3cyclictest9-21ksoftirqd/007:30:000
989993730,4cyclictest9-21ksoftirqd/008:25:160
989993730,4cyclictest9-21ksoftirqd/008:23:270
989993730,4cyclictest9-21ksoftirqd/007:10:100
99299369,4cyclictest22915-21switchtime10:10:293
99299369,4cyclictest18810-21df_abs08:55:263
99299369,3cyclictest15153-21cat09:55:253
99299368,5cyclictest25896-21systemctl10:20:003
992993630,3cyclictest41-21ksoftirqd/310:49:403
992993630,3cyclictest41-21ksoftirqd/310:39:123
992993630,3cyclictest41-21ksoftirqd/307:23:103
992993629,4cyclictest41-21ksoftirqd/310:41:213
991993630,4cyclictest33-21ksoftirqd/208:05:222
991993629,4cyclictest33-21ksoftirqd/212:38:422
991993629,4cyclictest33-21ksoftirqd/211:51:452
991993629,4cyclictest33-21ksoftirqd/209:43:092
991993629,4cyclictest33-21ksoftirqd/208:34:502
991993628,5cyclictest33-21ksoftirqd/211:00:142
991993628,5cyclictest33-21ksoftirqd/208:56:382
991993628,5cyclictest33-21ksoftirqd/207:23:572
991993627,5cyclictest33-21ksoftirqd/207:15:192
989993630,4cyclictest9-21ksoftirqd/011:45:270
989993630,4cyclictest9-21ksoftirqd/009:25:280
989993630,4cyclictest9-21ksoftirqd/009:25:280
989993630,3cyclictest9-21ksoftirqd/010:25:000
989993629,5cyclictest9-21ksoftirqd/009:09:320
989993629,4cyclictest9-21ksoftirqd/011:25:010
989993629,4cyclictest9-21ksoftirqd/010:05:280
989993629,4cyclictest9-21ksoftirqd/009:45:170
99299353,8cyclictest7872-21apt-get10:50:173
99299353,7cyclictest21846-21apt-get11:20:183
992993530,3cyclictest41-21ksoftirqd/307:55:003
992993530,3cyclictest41-21ksoftirqd/307:55:003
992993529,4cyclictest41-21ksoftirqd/308:36:153
992993529,3cyclictest41-21ksoftirqd/307:35:093
992993528,4cyclictest41-21ksoftirqd/309:13:583
99299352,7cyclictest29024-21apt-get11:35:193
992993527,5cyclictest41-21ksoftirqd/311:10:513
992993513,19cyclictest14461-21ptp4l-jitter12:10:273
992993511,3cyclictest12078-21sshd10:58:333
992993511,3cyclictest12078-21sshd10:58:333
992993511,3cyclictest1100-21runrttasks12:19:153
991993529,3cyclictest33-21ksoftirqd/208:54:152
991993529,3cyclictest33-21ksoftirqd/208:39:442
991993528,4cyclictest33-21ksoftirqd/211:42:572
991993528,4cyclictest33-21ksoftirqd/209:25:002
991993528,4cyclictest33-21ksoftirqd/209:15:572
991993528,4cyclictest33-21ksoftirqd/207:29:212
991993527,5cyclictest33-21ksoftirqd/212:12:052
989993531,3cyclictest9-21ksoftirqd/011:55:330
989993530,3cyclictest9-21ksoftirqd/009:00:280
989993529,4cyclictest9-21ksoftirqd/011:04:140
989993529,4cyclictest9-21ksoftirqd/007:20:330
989993528,4cyclictest9-21ksoftirqd/010:19:140
989993528,4cyclictest9-21ksoftirqd/009:30:220
989993528,4cyclictest9-21ksoftirqd/008:30:110
99299346,4cyclictest27209-21fschecks_time11:30:193
99299343,8cyclictest26205-21apt-get10:20:163
992993427,5cyclictest41-21ksoftirqd/307:49:343
992993427,4cyclictest41-21ksoftirqd/311:59:203
992993410,3cyclictest1100-21runrttasks08:17:583
991993428,3cyclictest33-21ksoftirqd/212:22:252
991993428,3cyclictest33-21ksoftirqd/212:22:252
991993428,3cyclictest33-21ksoftirqd/210:03:082
991993428,3cyclictest33-21ksoftirqd/207:33:052
991993427,4cyclictest33-21ksoftirqd/210:33:212
991993427,4cyclictest33-21ksoftirqd/208:45:502
991993427,4cyclictest33-21ksoftirqd/208:25:382
991993427,4cyclictest33-21ksoftirqd/208:16:372
98999343,6cyclictest121rcu_preempt12:15:260
989993429,3cyclictest9-21ksoftirqd/008:15:290
989993428,4cyclictest9-21ksoftirqd/011:40:300
989993428,3cyclictest9-21ksoftirqd/012:35:170
989993428,3cyclictest9-21ksoftirqd/011:09:380
989993428,3cyclictest9-21ksoftirqd/009:40:170
989993428,3cyclictest9-21ksoftirqd/009:22:350
989993427,4cyclictest9-21ksoftirqd/011:11:080
989993427,4cyclictest9-21ksoftirqd/010:52:170
989993421,8cyclictest9-21ksoftirqd/009:35:170
825591340,27ptp4l99299cyclictest09:20:223
991993327,3cyclictest33-21ksoftirqd/211:56:572
991993327,3cyclictest33-21ksoftirqd/209:37:542
991993326,4cyclictest33-21ksoftirqd/211:18:532
991993326,4cyclictest33-21ksoftirqd/210:55:242
991993326,4cyclictest33-21ksoftirqd/210:55:242
991993326,4cyclictest33-21ksoftirqd/210:25:172
991993326,4cyclictest33-21ksoftirqd/208:10:362
991993326,4cyclictest33-21ksoftirqd/207:50:372
991993326,4cyclictest33-21ksoftirqd/207:50:362
989993328,3cyclictest9-21ksoftirqd/008:48:010
989993327,3cyclictest9-21ksoftirqd/010:50:000
989993326,4cyclictest9-21ksoftirqd/009:51:510
989993326,4cyclictest9-21ksoftirqd/008:53:110
992993225,4cyclictest41-21ksoftirqd/309:39:463
99299321,10cyclictest24573-21apt-get12:35:003
991993226,4cyclictest33-21ksoftirqd/210:22:152
991993226,3cyclictest33-21ksoftirqd/210:35:472
991993225,4cyclictest33-21ksoftirqd/212:16:372
991993225,4cyclictest33-21ksoftirqd/210:05:062
989993226,4cyclictest9-21ksoftirqd/012:10:170
989993226,4cyclictest9-21ksoftirqd/011:52:030
989993226,3cyclictest9-21ksoftirqd/008:07:170
989993225,4cyclictest9-21ksoftirqd/010:26:280
989993225,4cyclictest9-21ksoftirqd/008:35:480
989993225,4cyclictest9-21ksoftirqd/008:03:050
991993125,3cyclictest33-21ksoftirqd/207:48:202
991993124,4cyclictest33-21ksoftirqd/209:45:122
991993124,4cyclictest33-21ksoftirqd/209:05:452
991993123,5cyclictest33-21ksoftirqd/212:00:392
989993126,3cyclictest9-21ksoftirqd/010:43:550
991993024,3cyclictest33-21ksoftirqd/209:53:522
991993024,3cyclictest33-21ksoftirqd/207:39:122
991993023,4cyclictest33-21ksoftirqd/211:24:252
991993023,4cyclictest33-21ksoftirqd/210:43:332
991993023,4cyclictest33-21ksoftirqd/210:19:162
99199301,2cyclictest0-21swapper/209:10:332
991992922,4cyclictest33-21ksoftirqd/212:28:342
991992922,4cyclictest33-21ksoftirqd/212:28:342
991992922,4cyclictest33-21ksoftirqd/209:02:562
991992922,4cyclictest33-21ksoftirqd/208:41:162
991992822,4cyclictest33-21ksoftirqd/211:14:112
991992822,4cyclictest33-21ksoftirqd/209:55:282
989992822,3cyclictest9-21ksoftirqd/010:14:360
991992720,4cyclictest33-21ksoftirqd/209:25:572
991992720,4cyclictest33-21ksoftirqd/209:25:572
991992520,3cyclictest33-21ksoftirqd/211:36:552
991992519,3cyclictest33-21ksoftirqd/209:30:082
991992417,4cyclictest33-21ksoftirqd/210:45:282
991992318,3cyclictest33-21ksoftirqd/211:30:572
991992115,4cyclictest33-21ksoftirqd/210:10:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional