You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-09 - 17:28

x86 Intel Atom E3845 @1910 MHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot4.osadl.org (updated Wed Dec 07, 2022 12:46:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1299911910,6ptp4l401ktimersoftd/307:07:173
23000999944,4cyclictest25-21ksoftirqd/112:40:001
23000997634,8cyclictest25-21ksoftirqd/109:15:281
23000997531,4cyclictest25-21ksoftirqd/109:26:151
23000997452,5cyclictest25-21ksoftirqd/108:55:041
23000997433,8cyclictest25-21ksoftirqd/108:40:291
56498730,8rtkit-daemon563-21rtkit-daemon07:08:112
23000997130,8cyclictest25-21ksoftirqd/110:45:331
23000997129,3cyclictest121rcu_preempt11:48:361
23000997032,8cyclictest25-21ksoftirqd/111:40:281
23000997029,3cyclictest121rcu_preempt07:11:471
23000996964,3cyclictest25-21ksoftirqd/107:45:121
23000996930,7cyclictest25-21ksoftirqd/110:30:231
23000996929,8cyclictest25-21ksoftirqd/111:30:271
23002996856,7cyclictest41-21ksoftirqd/312:35:163
23000996830,4cyclictest25-21ksoftirqd/109:30:291
23000996830,4cyclictest25-21ksoftirqd/109:30:281
23000996829,5cyclictest25-21ksoftirqd/107:30:271
23000996820,10cyclictest25-21ksoftirqd/112:07:341
23002996757,4cyclictest41-21ksoftirqd/307:55:123
23002996757,4cyclictest41-21ksoftirqd/307:55:123
23000996738,4cyclictest25-21ksoftirqd/110:00:011
23000996730,10cyclictest25-21ksoftirqd/110:05:341
23000996729,9cyclictest25-21ksoftirqd/109:45:261
23000996729,5cyclictest25-21ksoftirqd/108:05:161
23000996728,8cyclictest25-21ksoftirqd/112:30:291
23000996728,8cyclictest25-21ksoftirqd/112:30:281
23000996727,3cyclictest121rcu_preempt10:44:401
23000996725,3cyclictest121rcu_preempt07:17:221
23000996661,3cyclictest231rcuc/108:00:521
23000996661,3cyclictest231rcuc/108:00:511
2300099663,9cyclictest25-21ksoftirqd/107:29:591
23000996631,11cyclictest25-21ksoftirqd/112:00:281
23000996629,5cyclictest25-21ksoftirqd/108:20:241
305812630,8sleep22300199cyclictest09:40:362
23002996355,4cyclictest41-21ksoftirqd/311:55:143
23002996317,10cyclictest41-21ksoftirqd/307:40:283
2300099637,4cyclictest25-21ksoftirqd/110:25:221
23000996327,5cyclictest25-21ksoftirqd/110:10:141
23000996321,3cyclictest121rcu_preempt08:17:311
23002996254,5cyclictest41-21ksoftirqd/309:30:153
23002996254,5cyclictest41-21ksoftirqd/309:30:143
23002996254,4cyclictest41-21ksoftirqd/309:15:123
2300199620,7cyclictest14169-21turbostat08:00:002
2300199620,7cyclictest14169-21turbostat08:00:002
2300099627,4cyclictest25-21ksoftirqd/111:40:011
23000996257,3cyclictest25-21ksoftirqd/111:15:051
23000996228,8cyclictest25-21ksoftirqd/110:35:331
23000996227,3cyclictest121rcu_preempt09:24:061
23000996226,5cyclictest25-21ksoftirqd/111:14:361
23000996225,5cyclictest25-21ksoftirqd/109:00:191
22632620,3sleep10-21swapper/109:50:191
23002996154,4cyclictest41-21ksoftirqd/308:30:133
23002996153,4cyclictest41-21ksoftirqd/311:10:163
23000996155,4cyclictest25-21ksoftirqd/111:05:191
23000996124,8cyclictest25-21ksoftirqd/108:35:221
2300099610,3cyclictest121rcu_preempt07:45:001
131562610,8sleep22300199cyclictest11:20:362
23002996052,4cyclictest41-21ksoftirqd/312:00:143
23002996052,4cyclictest41-21ksoftirqd/308:40:113
23002996041,7cyclictest41-21ksoftirqd/312:20:003
23002996035,10cyclictest41-21ksoftirqd/311:00:213
23002996035,10cyclictest41-21ksoftirqd/311:00:203
2300099608,3cyclictest25-21ksoftirqd/112:20:291
2300099607,3cyclictest25-21ksoftirqd/111:50:301
2300099601,3cyclictest121rcu_preempt08:49:591
23002995953,4cyclictest41-21ksoftirqd/309:45:113
23002995952,4cyclictest41-21ksoftirqd/310:55:143
23002995952,4cyclictest41-21ksoftirqd/309:20:143
23002995952,4cyclictest41-21ksoftirqd/307:35:163
23002995951,5cyclictest41-21ksoftirqd/307:20:163
23000995925,10cyclictest25-21ksoftirqd/110:56:131
23000995922,9cyclictest25-21ksoftirqd/108:10:131
22999995939,5cyclictest9-21ksoftirqd/008:10:000
22999995918,8cyclictest9-21ksoftirqd/012:05:230
36162580,3sleep10-21swapper/111:00:321
36162580,3sleep10-21swapper/111:00:321
23002995852,3cyclictest41-21ksoftirqd/312:30:133
23002995852,3cyclictest41-21ksoftirqd/312:30:133
23002995851,4cyclictest41-21ksoftirqd/307:25:123
2300099588,3cyclictest121rcu_preempt07:20:331
2300099587,4cyclictest25-21ksoftirqd/109:05:291
23000995851,4cyclictest25-21ksoftirqd/109:10:041
23000995845,3cyclictest25-21ksoftirqd/112:25:311
2300099583,10cyclictest25-21ksoftirqd/109:35:421
23000995827,4cyclictest25-21ksoftirqd/110:00:201
2300099581,9cyclictest25-21ksoftirqd/110:15:221
2300099581,9cyclictest25-21ksoftirqd/107:55:251
2300099581,9cyclictest25-21ksoftirqd/107:55:241
2300099580,3cyclictest121rcu_preempt08:55:011
22999995829,4cyclictest9-21ksoftirqd/012:05:000
23002995750,4cyclictest41-21ksoftirqd/310:15:133
23002995750,4cyclictest41-21ksoftirqd/307:50:153
23000995747,3cyclictest25-21ksoftirqd/111:20:371
23000995742,4cyclictest25-21ksoftirqd/110:55:001
2300099572,9cyclictest25-21ksoftirqd/111:55:201
2300099571,8cyclictest25-21ksoftirqd/108:25:321
23002995650,3cyclictest41-21ksoftirqd/310:35:173
23002995649,4cyclictest41-21ksoftirqd/310:50:133
23002995649,4cyclictest41-21ksoftirqd/309:05:183
23001995649,4cyclictest33-21ksoftirqd/210:20:012
2300099566,6cyclictest25-21ksoftirqd/108:30:141
2300099561,6cyclictest0-21swapper/112:15:001
23002995549,4cyclictest41-21ksoftirqd/308:15:113
23002995548,4cyclictest41-21ksoftirqd/309:55:133
23002995548,4cyclictest41-21ksoftirqd/308:45:133
23001995548,4cyclictest4402-21sh07:40:012
23001995520,6cyclictest33-21ksoftirqd/212:10:002
2300099555,3cyclictest121rcu_preempt09:40:281
23000995539,5cyclictest25-21ksoftirqd/111:30:011
22999995548,4cyclictest9-21ksoftirqd/011:20:000
2299999551,8cyclictest7259-21apt-get07:45:120
2299999550,4cyclictest121rcu_preempt10:30:000
23002995448,4cyclictest41-21ksoftirqd/308:50:133
23002995447,4cyclictest41-21ksoftirqd/311:30:153
2300099545,4cyclictest121rcu_preempt07:50:291
23000995445,3cyclictest25-21ksoftirqd/112:15:201
2300099542,9cyclictest25-21ksoftirqd/107:35:291
2300099541,7cyclictest25-21ksoftirqd/110:20:331
22999995439,4cyclictest9-21ksoftirqd/011:25:000
22999995337,5cyclictest9-21ksoftirqd/011:40:350
2299999531,7cyclictest4216-21open_inodes08:45:270
23002995244,4cyclictest41-21ksoftirqd/311:15:053
23001995246,4cyclictest33-21ksoftirqd/207:15:012
23001995245,4cyclictest33-21ksoftirqd/210:30:152
22999995242,3cyclictest9-21ksoftirqd/009:55:000
22999995213,7cyclictest9-21ksoftirqd/011:45:230
23002995144,4cyclictest41-21ksoftirqd/307:30:143
23002995138,10cyclictest41-21ksoftirqd/311:45:273
2300299510,4cyclictest121rcu_preempt12:10:003
2300299510,4cyclictest121rcu_preempt11:35:223
2300199515,4cyclictest121rcu_preempt08:25:262
22999995132,9cyclictest9-21ksoftirqd/009:35:360
2299999510,6cyclictest9-21ksoftirqd/010:40:000
56498500,11rtkit-daemon0-21swapper/008:38:480
23002995044,4cyclictest41-21ksoftirqd/311:40:163
23002995044,4cyclictest41-21ksoftirqd/308:05:163
23002995043,4cyclictest41-21ksoftirqd/312:25:163
23002995043,4cyclictest41-21ksoftirqd/309:40:173
23002995043,4cyclictest41-21ksoftirqd/309:00:013
23002995043,3cyclictest41-21ksoftirqd/309:25:133
23002995042,5cyclictest41-21ksoftirqd/311:50:133
23002995042,4cyclictest41-21ksoftirqd/311:10:013
2300299500,15cyclictest121rcu_preempt07:15:283
23001995032,5cyclictest33-21ksoftirqd/211:15:002
23001995031,4cyclictest33-21ksoftirqd/207:45:152
22999995044,4cyclictest9-21ksoftirqd/009:59:590
22999995044,3cyclictest9-21ksoftirqd/007:55:000
22999995043,4cyclictest9-21ksoftirqd/010:30:150
23002994942,4cyclictest41-21ksoftirqd/310:20:163
23002994942,3cyclictest41-21ksoftirqd/310:10:213
23002994941,5cyclictest41-21ksoftirqd/312:20:153
23001994942,4cyclictest33-21ksoftirqd/209:20:002
23001994933,5cyclictest33-21ksoftirqd/208:15:162
22999994943,3cyclictest9-21ksoftirqd/007:29:590
22999994934,5cyclictest9-21ksoftirqd/007:40:000
23002994841,4cyclictest41-21ksoftirqd/307:45:133
23002994841,3cyclictest41-21ksoftirqd/309:00:203
23002994841,3cyclictest41-21ksoftirqd/308:05:003
23002994841,3cyclictest41-21ksoftirqd/308:04:593
23002994835,10cyclictest41-21ksoftirqd/310:45:223
23001994842,4cyclictest33-21ksoftirqd/212:15:002
23001994842,4cyclictest33-21ksoftirqd/210:40:002
23001994832,5cyclictest33-21ksoftirqd/209:35:442
22999994841,4cyclictest9-21ksoftirqd/011:05:000
22999994841,4cyclictest9-21ksoftirqd/011:05:000
22999994833,5cyclictest9-21ksoftirqd/011:31:070
2299999482,6cyclictest9-21ksoftirqd/007:17:120
23002994742,3cyclictest41-21ksoftirqd/310:29:593
23002994741,3cyclictest41-21ksoftirqd/308:30:013
2300299470,12cyclictest41-21ksoftirqd/310:08:463
23001994741,4cyclictest33-21ksoftirqd/209:55:002
23001994740,4cyclictest33-21ksoftirqd/211:40:002
2300199472,5cyclictest10267-21sendmail08:59:592
22999994742,3cyclictest9-21ksoftirqd/012:25:240
22999994741,3cyclictest9-21ksoftirqd/008:15:000
23002994640,3cyclictest41-21ksoftirqd/309:50:303
23002994640,3cyclictest41-21ksoftirqd/309:40:003
23002994640,3cyclictest41-21ksoftirqd/307:15:013
23002994639,4cyclictest41-21ksoftirqd/308:40:013
23002994638,5cyclictest27187-21cron10:45:003
23001994640,4cyclictest33-21ksoftirqd/208:40:012
2300199463,12cyclictest30094-21cat12:00:002
23001994628,5cyclictest33-21ksoftirqd/210:40:212
23001994619,6cyclictest33-21ksoftirqd/208:55:002
23001994617,4cyclictest33-21ksoftirqd/208:50:002
22999994641,3cyclictest9-21ksoftirqd/009:10:000
22999994640,3cyclictest9-21ksoftirqd/011:40:000
22999994640,3cyclictest9-21ksoftirqd/010:24:590
22999994640,3cyclictest9-21ksoftirqd/009:00:000
22999994639,4cyclictest9-21ksoftirqd/010:20:010
2299999463,6cyclictest9-21ksoftirqd/012:20:000
22999994612,9cyclictest9-21ksoftirqd/010:05:190
22999994611,5cyclictest9-21ksoftirqd/010:50:200
2238924614,20sleep10-21swapper/107:05:541
23002994540,3cyclictest41-21ksoftirqd/311:20:323
23002994540,3cyclictest41-21ksoftirqd/308:20:343
23002994539,3cyclictest41-21ksoftirqd/310:35:003
2300199457,5cyclictest33-21ksoftirqd/212:22:172
23001994539,4cyclictest33-21ksoftirqd/212:40:002
23001994539,4cyclictest33-21ksoftirqd/212:00:332
23001994539,4cyclictest33-21ksoftirqd/210:15:002
23001994539,3cyclictest33-21ksoftirqd/209:24:592
23001994531,11cyclictest33-21ksoftirqd/210:00:342
2299999457,6cyclictest9-21ksoftirqd/008:00:280
2299999457,6cyclictest9-21ksoftirqd/008:00:270
22999994539,4cyclictest9-21ksoftirqd/012:20:330
22999994526,8cyclictest9-21ksoftirqd/009:30:240
22999994526,8cyclictest9-21ksoftirqd/009:30:230
2300299446,4cyclictest41-21ksoftirqd/310:00:213
23002994436,4cyclictest41-21ksoftirqd/308:10:143
23001994438,4cyclictest33-21ksoftirqd/207:35:002
23001994438,3cyclictest33-21ksoftirqd/209:45:142
23001994438,3cyclictest33-21ksoftirqd/209:10:002
23001994437,4cyclictest33-21ksoftirqd/210:25:162
23001994437,4cyclictest33-21ksoftirqd/210:10:012
23001994427,5cyclictest33-21ksoftirqd/212:30:172
23001994427,5cyclictest33-21ksoftirqd/212:30:162
23001994424,7cyclictest33-21ksoftirqd/211:15:402
23001994424,10cyclictest33-21ksoftirqd/211:10:002
2299999446,4cyclictest9-21ksoftirqd/010:10:230
2299999444,4cyclictest9-21ksoftirqd/012:00:000
22999994439,3cyclictest9-21ksoftirqd/007:45:000
22999994438,4cyclictest9-21ksoftirqd/010:45:170
22999994438,3cyclictest9-21ksoftirqd/009:40:310
22999994437,4cyclictest9-21ksoftirqd/009:25:180
22999994416,4cyclictest9-21ksoftirqd/009:15:330
2249024415,18sleep00-21swapper/007:07:150
23002994338,3cyclictest41-21ksoftirqd/309:10:203
23001994336,4cyclictest33-21ksoftirqd/212:19:592
2300199432,7cyclictest0-21swapper/211:50:312
2300199431,5cyclictest554-21dbus-daemon11:00:192
2300199431,5cyclictest554-21dbus-daemon11:00:182
2300199430,6cyclictest33-21ksoftirqd/210:54:592
2299999435,7cyclictest9-21ksoftirqd/011:50:260
22999994338,3cyclictest9-21ksoftirqd/012:40:010
22999994337,4cyclictest9-21ksoftirqd/009:10:140
22999994336,4cyclictest9-21ksoftirqd/007:20:340
23001994237,3cyclictest33-21ksoftirqd/210:24:592
23001994237,3cyclictest33-21ksoftirqd/210:00:002
23001994236,4cyclictest33-21ksoftirqd/211:45:362
23001994236,4cyclictest33-21ksoftirqd/208:20:282
23001994236,4cyclictest33-21ksoftirqd/207:40:152
23001994236,3cyclictest33-21ksoftirqd/211:25:142
23001994235,4cyclictest33-21ksoftirqd/211:30:272
2300199422,6cyclictest0-21swapper/207:25:192
23001994215,4cyclictest33-21ksoftirqd/209:11:092
22999994237,3cyclictest9-21ksoftirqd/010:45:000
22999994236,4cyclictest9-21ksoftirqd/008:15:130
22999994236,4cyclictest9-21ksoftirqd/007:30:220
22999994236,3cyclictest9-21ksoftirqd/011:15:000
22999994236,3cyclictest9-21ksoftirqd/009:00:300
22999994236,3cyclictest9-21ksoftirqd/008:50:150
2299999422,4cyclictest121rcu_preempt12:10:260
22999994217,8cyclictest9-21ksoftirqd/011:28:210
2299999421,4cyclictest9-21ksoftirqd/008:45:000
23002994134,4cyclictest41-21ksoftirqd/311:25:143
23001994136,3cyclictest33-21ksoftirqd/209:30:002
23001994136,3cyclictest33-21ksoftirqd/208:10:012
23001994135,4cyclictest33-21ksoftirqd/212:25:162
23001994134,4cyclictest33-21ksoftirqd/208:40:192
23001994134,3cyclictest33-21ksoftirqd/208:05:012
23001994134,3cyclictest33-21ksoftirqd/208:05:002
2300199411,5cyclictest0-21swapper/209:00:142
2299999415,4cyclictest9-21ksoftirqd/007:55:180
2299999415,4cyclictest9-21ksoftirqd/007:55:170
2299999414,4cyclictest9-21ksoftirqd/008:20:330
2299999413,9cyclictest9-21ksoftirqd/008:25:170
22999994113,4cyclictest9-21ksoftirqd/011:05:280
22999994112,4cyclictest9-21ksoftirqd/010:55:170
23002994034,3cyclictest41-21ksoftirqd/312:15:003
23001994034,4cyclictest33-21ksoftirqd/209:30:242
23001994034,4cyclictest33-21ksoftirqd/209:30:232
23001994024,5cyclictest33-21ksoftirqd/207:20:232
23001994023,5cyclictest33-21ksoftirqd/211:40:192
22999994035,3cyclictest9-21ksoftirqd/010:05:010
22999994034,4cyclictest9-21ksoftirqd/012:30:190
22999994034,4cyclictest9-21ksoftirqd/012:30:180
22999994023,5cyclictest9-21ksoftirqd/007:10:160
2299999401,4cyclictest9-21ksoftirqd/009:20:290
23001993932,5cyclictest33-21ksoftirqd/210:45:142
2300199390,5cyclictest0-21swapper/207:15:282
22999993919,9cyclictest9-21ksoftirqd/008:30:280
23001993832,4cyclictest33-21ksoftirqd/211:00:012
23001993831,4cyclictest33-21ksoftirqd/208:10:132
22999993833,3cyclictest9-21ksoftirqd/009:45:210
23001993732,3cyclictest33-21ksoftirqd/208:30:292
23001993732,3cyclictest33-21ksoftirqd/207:55:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional