You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-09 - 17:24

x86 Intel Atom E3845 @1910 MHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot3.osadl.org (updated Wed Dec 07, 2022 12:46:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2363521730,8sleep1507499cyclictest07:50:011
461821660,9sleep0507399cyclictest09:25:220
825991151122,16phc2sys31265-21apache207:07:103
576981060,14rtkit-daemon0-21swapper/007:05:520
470828811,19sleep20-21swapper/207:09:002
5075997057,8cyclictest33-21ksoftirqd/211:25:132
275342670,7sleep3507699cyclictest12:30:303
5075996448,10cyclictest33-21ksoftirqd/208:20:192
315132640,3sleep20-21swapper/211:30:412
825591620,1ptp4l401ktimersoftd/310:25:363
5075995945,7cyclictest33-21ksoftirqd/208:55:132
159002590,5sleep1241ktimersoftd/107:30:291
159002590,5sleep1241ktimersoftd/107:30:291
115102590,7sleep2507599cyclictest08:30:272
825591540,1ptp4l401ktimersoftd/310:00:353
5075995342,6cyclictest33-21ksoftirqd/209:35:202
5075995338,8cyclictest33-21ksoftirqd/210:25:152
5075995238,8cyclictest33-21ksoftirqd/212:15:182
5075995238,7cyclictest33-21ksoftirqd/211:15:182
825591510,1ptp4l401ktimersoftd/312:03:383
57698510,2rtkit-daemon575-21rtkit-daemon11:41:512
825591500,1ptp4l401ktimersoftd/307:54:213
5076995031,4cyclictest41-21ksoftirqd/311:59:443
5076995029,5cyclictest41-21ksoftirqd/307:43:113
5075995045,3cyclictest33-21ksoftirqd/211:50:002
5074995045,3cyclictest25-21ksoftirqd/108:00:001
825591490,2ptp4l18345-21kworker/3:110:55:583
5076994929,4cyclictest41-21ksoftirqd/307:30:073
5076994929,4cyclictest41-21ksoftirqd/307:30:073
825591480,1ptp4l401ktimersoftd/310:49:363
57698470,4rtkit-daemon31259-21apache210:13:142
5075994741,3cyclictest33-21ksoftirqd/209:20:002
5075994734,8cyclictest33-21ksoftirqd/210:35:172
5075994638,4cyclictest33-21ksoftirqd/211:55:162
5075994632,8cyclictest33-21ksoftirqd/209:25:132
5075994615,6cyclictest33-21ksoftirqd/209:30:352
5075994539,4cyclictest33-21ksoftirqd/207:20:002
5075994533,9cyclictest33-21ksoftirqd/212:30:342
5075994530,8cyclictest33-21ksoftirqd/210:15:152
5073994539,4cyclictest9-21ksoftirqd/008:40:000
452824514,20sleep10-21swapper/107:06:431
825591440,1ptp4l401ktimersoftd/312:06:523
825591440,1ptp4l401ktimersoftd/312:06:513
5074994436,4cyclictest25-21ksoftirqd/112:15:231
825591430,10ptp4l401ktimersoftd/308:32:003
5075994338,3cyclictest33-21ksoftirqd/208:20:012
5075994337,3cyclictest33-21ksoftirqd/209:59:592
5075994336,4cyclictest33-21ksoftirqd/211:05:212
5075994331,10cyclictest33-21ksoftirqd/209:50:342
5074994338,3cyclictest25-21ksoftirqd/111:40:001
5074994338,3cyclictest25-21ksoftirqd/111:10:011
5074994337,4cyclictest25-21ksoftirqd/111:50:001
825591420,1ptp4l401ktimersoftd/309:40:283
825591420,1ptp4l401ktimersoftd/308:51:093
825591420,1ptp4l401ktimersoftd/308:41:583
825591420,1ptp4l401ktimersoftd/307:57:073
825591420,1ptp4l401ktimersoftd/307:13:503
5075994237,3cyclictest33-21ksoftirqd/212:25:002
5075994237,3cyclictest33-21ksoftirqd/208:25:172
5075994236,4cyclictest33-21ksoftirqd/207:45:002
5075994235,4cyclictest33-21ksoftirqd/210:35:002
5075994235,4cyclictest33-21ksoftirqd/210:35:002
5074994236,3cyclictest25-21ksoftirqd/112:30:241
5074994236,3cyclictest25-21ksoftirqd/109:09:591
5073994236,3cyclictest9-21ksoftirqd/009:35:000
825591410,1ptp4l401ktimersoftd/311:24:593
5075994135,4cyclictest33-21ksoftirqd/209:40:312
5075994134,4cyclictest33-21ksoftirqd/208:55:002
5074994136,3cyclictest25-21ksoftirqd/110:20:001
5074994134,4cyclictest25-21ksoftirqd/112:10:001
5074994134,4cyclictest25-21ksoftirqd/112:09:591
825591400,10ptp4l401ktimersoftd/309:59:263
5075994035,3cyclictest33-21ksoftirqd/209:10:002
5075994035,3cyclictest33-21ksoftirqd/208:00:012
5075994034,4cyclictest33-21ksoftirqd/210:25:002
5075994034,4cyclictest33-21ksoftirqd/208:45:242
5075994034,3cyclictest33-21ksoftirqd/211:15:012
5075994034,3cyclictest33-21ksoftirqd/208:44:592
5075994033,4cyclictest33-21ksoftirqd/212:10:002
5075994033,4cyclictest33-21ksoftirqd/207:10:212
5074994034,3cyclictest25-21ksoftirqd/112:00:001
825591390,1ptp4l401ktimersoftd/311:05:413
5075993934,3cyclictest33-21ksoftirqd/208:05:262
5075993933,4cyclictest33-21ksoftirqd/212:15:012
5075993932,4cyclictest33-21ksoftirqd/210:05:002
5074993934,3cyclictest25-21ksoftirqd/111:40:391
5074993932,4cyclictest25-21ksoftirqd/110:00:401
5074993932,3cyclictest25-21ksoftirqd/111:20:011
507499391,35cyclictest10648-21irqrtprio07:20:271
5073993932,4cyclictest9-21ksoftirqd/007:30:010
5073993931,5cyclictest9-21ksoftirqd/008:09:140
5073993931,5cyclictest9-21ksoftirqd/007:23:300
97122380,5sleep0507399cyclictest11:55:190
825991381,3phc2sys121rcu_preempt12:25:253
825591380,1ptp4l401ktimersoftd/309:36:513
5076993831,4cyclictest41-21ksoftirqd/312:24:443
507599384,3cyclictest121rcu_preempt10:50:222
5075993833,3cyclictest33-21ksoftirqd/210:50:012
5075993833,3cyclictest33-21ksoftirqd/207:35:262
5075993832,4cyclictest33-21ksoftirqd/209:15:012
5075993832,4cyclictest33-21ksoftirqd/207:25:162
5075993832,3cyclictest33-21ksoftirqd/207:25:002
5075993831,4cyclictest33-21ksoftirqd/212:40:002
5075993831,4cyclictest33-21ksoftirqd/212:05:002
5075993831,4cyclictest33-21ksoftirqd/209:01:152
5074993831,4cyclictest25-21ksoftirqd/112:04:591
5074993831,4cyclictest25-21ksoftirqd/111:01:581
825591370,1ptp4l391rcuc/310:10:233
5076993731,3cyclictest41-21ksoftirqd/310:42:003
5076993730,4cyclictest41-21ksoftirqd/310:25:003
5076993729,5cyclictest41-21ksoftirqd/308:39:203
5075993731,3cyclictest33-21ksoftirqd/209:21:392
5075993731,3cyclictest33-21ksoftirqd/208:10:202
5075993730,4cyclictest33-21ksoftirqd/211:20:182
5075993730,4cyclictest33-21ksoftirqd/211:00:342
5075993730,4cyclictest33-21ksoftirqd/208:35:252
5075993730,4cyclictest33-21ksoftirqd/207:30:212
5075993730,4cyclictest33-21ksoftirqd/207:30:212
5074993732,3cyclictest25-21ksoftirqd/112:25:191
5074993731,4cyclictest25-21ksoftirqd/110:40:431
5074993730,4cyclictest25-21ksoftirqd/111:53:391
5074993730,4cyclictest25-21ksoftirqd/111:10:521
5074993730,4cyclictest25-21ksoftirqd/110:25:141
5074993730,4cyclictest25-21ksoftirqd/108:46:481
5074993730,4cyclictest25-21ksoftirqd/107:12:561
5073993731,3cyclictest9-21ksoftirqd/012:19:060
5073993731,3cyclictest9-21ksoftirqd/010:50:100
5073993731,3cyclictest9-21ksoftirqd/010:31:190
5073993731,3cyclictest9-21ksoftirqd/010:31:180
5073993730,5cyclictest9-21ksoftirqd/010:09:000
5073993730,4cyclictest9-21ksoftirqd/010:12:390
5073993725,9cyclictest9-21ksoftirqd/008:00:000
825591360,1ptp4l401ktimersoftd/310:37:263
825591360,1ptp4l401ktimersoftd/309:08:523
825591360,13ptp4l401ktimersoftd/309:01:123
5076993629,4cyclictest41-21ksoftirqd/308:18:453
5075993631,3cyclictest33-21ksoftirqd/208:00:212
5075993631,3cyclictest33-21ksoftirqd/207:50:002
5075993630,4cyclictest33-21ksoftirqd/210:05:242
5075993629,4cyclictest33-21ksoftirqd/210:45:002
5075993629,4cyclictest33-21ksoftirqd/209:45:252
507599362,32cyclictest15003-21kworker/2:012:05:332
5074993632,3cyclictest25-21ksoftirqd/107:50:361
5074993631,3cyclictest25-21ksoftirqd/110:20:221
5074993630,4cyclictest25-21ksoftirqd/111:30:301
5074993630,4cyclictest25-21ksoftirqd/110:48:381
5074993630,4cyclictest25-21ksoftirqd/110:35:001
5074993630,4cyclictest25-21ksoftirqd/110:35:001
5074993630,4cyclictest25-21ksoftirqd/108:04:081
5074993630,3cyclictest25-21ksoftirqd/112:35:591
5074993630,3cyclictest25-21ksoftirqd/112:15:001
5074993630,3cyclictest25-21ksoftirqd/109:21:371
5074993630,3cyclictest25-21ksoftirqd/107:42:231
5074993629,4cyclictest25-21ksoftirqd/111:26:011
5074993629,4cyclictest25-21ksoftirqd/111:21:241
5074993629,4cyclictest25-21ksoftirqd/110:14:321
5074993629,4cyclictest25-21ksoftirqd/109:02:381
5074993629,4cyclictest25-21ksoftirqd/108:54:391
5073993631,3cyclictest9-21ksoftirqd/011:15:310
5073993630,4cyclictest9-21ksoftirqd/009:13:520
5073993630,3cyclictest9-21ksoftirqd/011:21:240
5073993630,3cyclictest9-21ksoftirqd/008:20:160
5073993629,4cyclictest9-21ksoftirqd/012:33:200
5073993629,4cyclictest9-21ksoftirqd/009:08:520
5073993629,4cyclictest9-21ksoftirqd/008:43:100
5073993629,4cyclictest9-21ksoftirqd/007:20:010
825591350,1ptp4l401ktimersoftd/311:45:343
5076993529,3cyclictest41-21ksoftirqd/310:05:533
5076993529,3cyclictest41-21ksoftirqd/309:49:263
5076993528,4cyclictest41-21ksoftirqd/312:18:233
5076993528,4cyclictest41-21ksoftirqd/311:50:403
5076993528,4cyclictest41-21ksoftirqd/308:49:233
5076993528,4cyclictest41-21ksoftirqd/308:12:103
5076993528,4cyclictest41-21ksoftirqd/307:47:173
5076993527,5cyclictest41-21ksoftirqd/311:37:523
5076993527,5cyclictest41-21ksoftirqd/311:00:073
5075993529,3cyclictest33-21ksoftirqd/211:55:002
5075993528,4cyclictest33-21ksoftirqd/210:55:352
5075993528,4cyclictest33-21ksoftirqd/207:55:012
5074993529,4cyclictest25-21ksoftirqd/108:05:351
5074993529,3cyclictest25-21ksoftirqd/109:52:201
5074993528,4cyclictest25-21ksoftirqd/110:07:591
5074993528,4cyclictest25-21ksoftirqd/109:25:541
5074993528,4cyclictest25-21ksoftirqd/108:58:531
5074993528,4cyclictest25-21ksoftirqd/108:38:131
5074993528,4cyclictest25-21ksoftirqd/107:16:401
5073993530,3cyclictest9-21ksoftirqd/008:29:590
5073993529,4cyclictest9-21ksoftirqd/012:20:240
5073993529,4cyclictest9-21ksoftirqd/009:37:140
5073993529,4cyclictest9-21ksoftirqd/007:30:140
5073993529,4cyclictest9-21ksoftirqd/007:30:140
5073993529,3cyclictest9-21ksoftirqd/012:02:040
5073993529,3cyclictest9-21ksoftirqd/011:39:080
5073993528,4cyclictest9-21ksoftirqd/012:06:560
5073993528,4cyclictest9-21ksoftirqd/012:06:550
5073993528,4cyclictest9-21ksoftirqd/011:48:490
5073993528,4cyclictest9-21ksoftirqd/011:32:550
5073993528,4cyclictest9-21ksoftirqd/011:04:210
5073993528,4cyclictest9-21ksoftirqd/010:56:580
5073993528,4cyclictest9-21ksoftirqd/010:02:100
5073993528,4cyclictest9-21ksoftirqd/009:48:420
5073993528,4cyclictest9-21ksoftirqd/009:17:390
5073993528,4cyclictest9-21ksoftirqd/008:11:310
5073993527,5cyclictest9-21ksoftirqd/010:28:560
825591340,1ptp4l401ktimersoftd/312:35:213
825591340,1ptp4l401ktimersoftd/309:16:513
825591340,11ptp4l401ktimersoftd/310:53:123
5076993428,3cyclictest41-21ksoftirqd/308:27:493
5076993427,5cyclictest41-21ksoftirqd/311:41:133
5076993427,4cyclictest41-21ksoftirqd/309:30:143
5076993427,4cyclictest41-21ksoftirqd/308:00:353
5076993426,5cyclictest41-21ksoftirqd/311:33:183
5075993429,3cyclictest33-21ksoftirqd/211:35:402
5074993429,3cyclictest25-21ksoftirqd/110:55:151
5074993429,3cyclictest25-21ksoftirqd/109:35:331
5074993428,4cyclictest25-21ksoftirqd/109:45:281
5074993427,4cyclictest25-21ksoftirqd/108:30:111
5074993427,4cyclictest25-21ksoftirqd/107:25:111
5073993428,4cyclictest9-21ksoftirqd/011:50:260
5073993428,3cyclictest9-21ksoftirqd/012:39:530
5073993428,3cyclictest9-21ksoftirqd/011:14:190
5073993428,3cyclictest9-21ksoftirqd/007:49:290
5073993427,4cyclictest9-21ksoftirqd/012:27:100
5073993427,4cyclictest9-21ksoftirqd/012:10:080
5073993427,4cyclictest9-21ksoftirqd/011:41:200
5073993427,4cyclictest9-21ksoftirqd/011:09:370
5073993427,4cyclictest9-21ksoftirqd/009:54:110
5073993427,4cyclictest9-21ksoftirqd/008:55:120
5073993427,4cyclictest9-21ksoftirqd/008:47:490
5073993427,4cyclictest9-21ksoftirqd/007:53:290
5073993427,4cyclictest9-21ksoftirqd/007:13:060
825591330,1ptp4l401ktimersoftd/312:11:553
825591330,1ptp4l401ktimersoftd/311:29:013
825591330,1ptp4l401ktimersoftd/311:17:393
825591330,10ptp4l401ktimersoftd/308:08:533
5076993326,4cyclictest41-21ksoftirqd/310:19:523
5076993326,4cyclictest41-21ksoftirqd/309:53:583
5074993327,4cyclictest25-21ksoftirqd/108:12:411
5074993326,4cyclictest25-21ksoftirqd/110:53:231
5074993326,4cyclictest25-21ksoftirqd/109:33:411
5074993326,4cyclictest25-21ksoftirqd/108:23:121
5074993326,4cyclictest25-21ksoftirqd/107:35:111
5073993327,4cyclictest9-21ksoftirqd/009:42:030
5073993326,4cyclictest9-21ksoftirqd/009:56:450
5073993326,4cyclictest9-21ksoftirqd/008:17:130
5073993326,4cyclictest9-21ksoftirqd/008:04:130
5073993326,4cyclictest9-21ksoftirqd/007:36:310
5076993226,3cyclictest41-21ksoftirqd/311:10:233
5076993226,3cyclictest41-21ksoftirqd/309:14:383
5076993226,3cyclictest41-21ksoftirqd/308:56:363
5076993226,3cyclictest41-21ksoftirqd/307:20:163
5076993225,4cyclictest41-21ksoftirqd/309:27:063
5075993226,4cyclictest33-21ksoftirqd/212:27:132
5074993227,3cyclictest25-21ksoftirqd/109:10:171
5074993226,3cyclictest25-21ksoftirqd/110:00:001
5073993225,4cyclictest9-21ksoftirqd/010:49:300
5073993225,4cyclictest9-21ksoftirqd/010:24:180
5076993124,4cyclictest41-21ksoftirqd/308:22:383
5074993124,4cyclictest25-21ksoftirqd/112:20:381
5074993124,4cyclictest25-21ksoftirqd/110:38:491
5074993124,4cyclictest25-21ksoftirqd/108:41:291
5074993124,4cyclictest25-21ksoftirqd/108:20:011
5073993125,4cyclictest9-21ksoftirqd/008:52:180
5073993124,4cyclictest9-21ksoftirqd/009:01:390
825591300,1ptp4l401ktimersoftd/309:21:193
825591300,1ptp4l401ktimersoftd/307:35:193
5076993024,4cyclictest41-21ksoftirqd/307:18:073
5073993024,3cyclictest9-21ksoftirqd/011:25:060
5073993023,4cyclictest9-21ksoftirqd/010:15:390
5074992924,3cyclictest25-21ksoftirqd/108:25:321
5074992923,3cyclictest25-21ksoftirqd/109:16:101
5073992922,4cyclictest9-21ksoftirqd/009:21:030
5073992922,4cyclictest9-21ksoftirqd/008:30:540
5073992822,4cyclictest9-21ksoftirqd/010:42:010
5076992721,3cyclictest41-21ksoftirqd/310:30:413
5076992721,3cyclictest41-21ksoftirqd/310:30:413
5073992721,3cyclictest9-21ksoftirqd/010:37:000
5076992619,4cyclictest41-21ksoftirqd/307:28:033
5074992620,3cyclictest25-21ksoftirqd/109:40:311
5073992315,5cyclictest19824-21ps07:40:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional