You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-08 - 19:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec

ARM Freescale i.MX8M Plus @1600 MHz, Linux 5.17.0-rt15 (Profile)

Latency plot of shadow in rack #b, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q done
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackbslot5s (updated Mon Aug 08, 2022 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
408442599512,5cyclictest131rcu_preempt07:15:170
408442599512,5cyclictest131rcu_preempt07:15:170
4084425994926,8cyclictest131rcu_preempt09:55:190
4084438994738,6cyclictest4101601-21unixbench_multi07:55:283
4084434994739,5cyclictest4098661-21sh07:50:002
4084425994639,5cyclictest4092003-21kworker/u8:0+events_unbound08:27:320
4084425994638,5cyclictest4166562-21unixbench_singl11:05:290
4084425994635,7cyclictest4176845-21grep11:35:330
4084434994532,8cyclictest4188724-21tail12:10:312
4084425994539,4cyclictest4129654-21kworker/u8:2+events_unbound09:32:360
4084425994539,4cyclictest4098904-21kworker/u8:2+events_unbound07:57:300
4084438994435,6cyclictest4180262-21unixbench_singl11:45:303
4084429994434,8cyclictest231ktimers/109:25:191
4084429994335,5cyclictest4136219-21kworker/u8:1+events_unbound10:32:431
4084429994330,9cyclictest4096577-21grep07:40:431
4084429994330,9cyclictest4096577-21grep07:40:421
4084429994231,7cyclictest4122100-21grep08:55:261
4084434994131,7cyclictest4170382-21sendmail11:19:592
4084429994134,4cyclictest4141413-21idleruntime-cro09:55:001
4084425994131,7cyclictest4105650-21apt-key08:10:020
4084429994032,5cyclictest4134586-21cron09:35:011
4084429994028,8cyclictest0-21swapper/111:30:011
4084429994028,8cyclictest0-21swapper/111:30:011
4084429993928,7cyclictest0-21swapper/111:35:331
4084434993831,4cyclictest3720-21munin-run12:40:012
4084429993729,4cyclictest0-21swapper/110:05:391
4084429993727,6cyclictest4144426-21unixbench_singl10:00:341
4084429993727,6cyclictest4144426-21unixbench_singl10:00:331
4084425993729,4cyclictest0-21swapper/007:40:010
4084425993725,8cyclictest4178578-21grep11:40:310
4084438993628,4cyclictest0-21swapper/311:20:003
4084438993627,7cyclictest4092003-21kworker/u8:0+events_unbound08:42:323
4084438993627,6cyclictest391ktimers/307:40:153
4084438993627,6cyclictest391ktimers/307:40:153
4084438993627,6cyclictest0-21swapper/309:25:013
4084429993627,5cyclictest4105059-21grep08:05:321
4084425993628,3cyclictest0-21swapper/011:29:590
4084425993628,3cyclictest0-21swapper/011:29:590
4084425993619,11cyclictest4180329-21kworker/u8:2+events_unbound12:25:230
4084438993526,5cyclictest0-21swapper/310:20:003
4084438993525,5cyclictest0-21swapper/309:37:363
4084434993528,4cyclictest4178967-21cron11:45:002
4084434993527,4cyclictest0-21swapper/212:25:172
4084434993527,4cyclictest0-21swapper/207:20:372
408442999351,6cyclictest24-21ksoftirqd/109:40:151
4084425993524,9cyclictest121ktimers/009:40:150
4084438993425,6cyclictest0-21swapper/308:20:003
4084438993425,4cyclictest0-21swapper/310:50:343
408443499349,4cyclictest41869412grep12:05:322
4084429993423,7cyclictest4139236-21grep09:45:321
4084425993419,12cyclictest0-21swapper/008:20:250
408442599341,5cyclictest131rcu_preempt11:10:160
408442599341,5cyclictest131rcu_preempt09:50:190
4084438993325,4cyclictest0-21swapper/310:35:353
4084438993325,4cyclictest0-21swapper/309:25:233
4084438993323,6cyclictest0-21swapper/307:20:013
4084438993323,6cyclictest0-21swapper/307:20:013
4084438993319,5cyclictest4175180-21kworker/u8:4+events_unbound12:12:373
4084434993325,4cyclictest0-21swapper/209:50:242
4084434993325,4cyclictest0-21swapper/207:10:372
4084434993325,4cyclictest0-21swapper/207:10:362
4084429993323,6cyclictest0-21swapper/109:10:011
4084429993322,8cyclictest221rcuc/109:55:191
4084429993318,6cyclictest4163790-21kworker/u8:0+events_unbound11:10:221
4084425993324,6cyclictest4096576-21grep07:40:430
4084425993324,6cyclictest4096576-21grep07:40:420
4084425993322,7cyclictest4108959-21munin-run08:20:000
4084425993313,18cyclictest0-21swapper/011:00:010
4084425993310,20cyclictest4114421-21df08:35:190
408443899326,4cyclictest131rcu_preempt08:00:173
4084438993226,3cyclictest4163568-21sendmail11:00:013
4084438993225,4cyclictest0-21swapper/312:15:293
4084438993223,6cyclictest0-21swapper/307:49:593
4084434993225,4cyclictest0-21swapper/210:05:402
4084434993224,4cyclictest0-21swapper/210:10:352
4084429993224,4cyclictest0-21swapper/110:50:011
4084429993223,4cyclictest0-21swapper/111:35:001
4084429993222,6cyclictest0-21swapper/112:00:291
4084429993222,6cyclictest0-21swapper/111:05:301
4084429993222,6cyclictest0-21swapper/110:40:301
4084429993222,6cyclictest0-21swapper/108:05:001
4084429993221,7cyclictest4136312-21sendmail09:40:011
4084429993218,5cyclictest4186029-21kworker/u8:0+events_unbound12:26:041
408442599322,5cyclictest131rcu_preempt10:15:170
4084425993225,5cyclictest4180329-21kworker/u8:2+events_unbound12:20:210
4084425993223,6cyclictest0-21swapper/009:25:330
4084438993124,3cyclictest0-21swapper/309:59:593
4084438993124,3cyclictest0-21swapper/307:24:593
4084438993123,4cyclictest0-21swapper/308:45:193
4084438993122,6cyclictest0-21swapper/310:20:343
4084438993122,6cyclictest0-21swapper/309:00:013
4084438993122,4cyclictest0-21swapper/311:05:293
4084438993111,12cyclictest4092003-21kworker/u8:0+events_unbound07:35:393
4084434993124,4cyclictest0-21swapper/208:55:012
4084434993123,4cyclictest0-21swapper/211:00:292
4084434993118,9cyclictest311ktimers/212:15:152
4084429993125,3cyclictest0-21swapper/109:25:011
4084429993124,5cyclictest4064506-21kworker/u8:2+events_unbound07:34:101
4084429993124,4cyclictest4115794-21idleruntime-cro08:40:011
4084429993124,4cyclictest0-21swapper/111:55:301
4084429993124,4cyclictest0-21swapper/111:55:301
4084429993122,4cyclictest0-21swapper/112:30:191
4084425993124,3cyclictest0-21swapper/009:50:010
4084425993123,4cyclictest0-21swapper/007:15:010
4084425993123,4cyclictest0-21swapper/007:15:010
4084425993121,6cyclictest0-21swapper/009:10:330
4084425993119,8cyclictest4129428-21sendmail09:20:010
4084425993114,11cyclictest0-21swapper/010:55:010
4084438993023,3cyclictest0-21swapper/309:10:013
4084438993022,4cyclictest0-21swapper/309:05:003
4084438993021,5cyclictest0-21swapper/310:35:013
4084434993023,4cyclictest4184075-21munin-plugin-st11:59:592
4084434993023,4cyclictest4184075-21munin-plugin-st11:59:592
4084434993023,4cyclictest0-21swapper/209:25:342
408442999309,6cyclictest4098904-21kworker/u8:2+events_unbound07:51:211
4084429993023,5cyclictest4106879-21kworker/u8:4+events_unbound08:25:151
4084429993023,4cyclictest4093895-21cut07:35:201
4084429993022,5cyclictest0-21swapper/107:20:231
4084429993019,7cyclictest4188731-21grep12:10:311
4084425993023,3cyclictest0-21swapper/011:50:280
4084425993021,5cyclictest4185307-21grep12:00:300
4084425993019,8cyclictest1566-21grep12:30:290
408443899295,4cyclictest4184070-21sendmail12:00:003
408443899295,4cyclictest4184070-21sendmail12:00:003
4084438992923,3cyclictest4138016-21kthreadd09:45:013
4084438992923,3cyclictest0-21swapper/309:15:013
4084438992922,4cyclictest0-21swapper/310:15:003
4084438992922,3cyclictest0-21swapper/309:17:343
4084438992921,5cyclictest0-21swapper/309:45:323
4084438992920,6cyclictest0-21swapper/308:05:233
4084438992918,8cyclictest4109383-21tune2fs08:20:163
4084434992922,3cyclictest0-21swapper/207:30:202
4084434992921,4cyclictest0-21swapper/209:15:342
4084434992920,5cyclictest0-21swapper/211:30:202
4084434992918,7cyclictest0-21swapper/207:17:262
4084434992918,7cyclictest0-21swapper/207:17:262
4084434992916,10cyclictest4084419-21cyclictest07:50:152
408442999294,6cyclictest131rcu_preempt11:40:141
4084429992920,5cyclictest4113617-21grep08:30:301
4084429992918,8cyclictest4150333-21fschecks_count10:20:221
4084429992918,7cyclictest3706-21cron12:40:001
4084429992917,8cyclictest4108528-21grep08:15:261
408442999291,4cyclictest131rcu_preempt10:35:201
4084425992923,3cyclictest0-21swapper/011:05:000
4084425992922,3cyclictest0-21swapper/010:10:000
4084425992922,3cyclictest0-21swapper/007:50:340
4084425992921,4cyclictest0-21swapper/008:10:200
4084425992921,4cyclictest0-21swapper/008:10:190
4084425992920,6cyclictest4157194-21tune2fs10:40:200
4084438992822,4cyclictest4168580-21kworker/u8:1+events_unbound11:42:103
4084438992820,4cyclictest0-21swapper/312:00:303
4084438992819,5cyclictest0-21swapper/312:39:593
408443899280,5cyclictest131rcu_preempt11:00:153
408443499288,8cyclictest4095184-21cat07:40:002
4084434992821,3cyclictest0-21swapper/210:20:332
4084434992820,4cyclictest0-21swapper/210:32:422
4084434992818,7cyclictest4117006-21grep08:40:282
4084429992822,4cyclictest4175180-21kworker/u8:4+events_unbound12:09:091
4084429992821,5cyclictest4180329-21kworker/u8:2+events_unbound11:46:491
4084429992820,4cyclictest4110189-21grep08:20:241
4084429992819,6cyclictest4147250-21ls10:10:281
4084429992817,7cyclictest4129417-21run-parts09:20:001
408442999281,4cyclictest131rcu_preempt09:00:151
4084425992822,3cyclictest0-21swapper/009:10:010
4084425992821,5cyclictest4092003-21kworker/u8:0+events_unbound09:35:100
4084425992819,6cyclictest0-21swapper/011:35:000
4084425992812,13cyclictest0-21swapper/010:30:010
408442599281,16cyclictest0-21swapper/011:23:000
408442599281,16cyclictest0-21swapper/011:23:000
408442599281,16cyclictest0-21swapper/008:40:520
408443899278,4cyclictest131rcu_preempt07:10:263
408443899278,4cyclictest131rcu_preempt07:10:253
4084438992720,4cyclictest4176848-21unixbench_singl11:35:333
4084438992720,4cyclictest0-21swapper/309:50:343
4084438992720,3cyclictest0-21swapper/310:25:213
4084438992717,6cyclictest0-21swapper/312:30:013
4084438992713,4cyclictest4127374-21kworker/u8:3+events_unbound10:46:093
4084434992721,4cyclictest4106879-21kworker/u8:4+events_unbound08:22:002
4084434992718,5cyclictest0-21swapper/210:40:202
4084434992718,4cyclictest0-21swapper/211:45:292
408442999277,3cyclictest131rcu_preempt12:20:011
4084429992721,4cyclictest4153314-21kworker/u8:0+events_unbound10:50:301
4084429992721,4cyclictest4103703-21kworker/u8:3+events_unbound08:14:101
4084429992721,4cyclictest4103703-21kworker/u8:3+events_unbound08:14:101
408442999271,4cyclictest131rcu_preempt12:20:141
408442999270,12cyclictest0-21swapper/107:48:541
408442599279,5cyclictest4127374-21kworker/u8:3+events_unbound10:32:340
408442599279,5cyclictest4101740-21kworker/u8:1+events_unbound08:00:420
408442599272,8cyclictest4118717-21grep08:45:290
4084425992723,2cyclictest13550irq/42-30be0000.ethernet12:05:300
408442599272,20cyclictest2459-21grep12:35:220
4084425992718,5cyclictest4182817-21grep11:55:200
4084425992718,5cyclictest4182817-21grep11:55:200
408442599271,13cyclictest0-21swapper/009:02:450
408443899264,14cyclictest0-21swapper/307:25:323
4084438992619,4cyclictest0-21swapper/312:05:233
4084438992616,6cyclictest4157977-21grep10:40:293
4084434992619,4cyclictest0-21swapper/210:00:002
4084434992619,4cyclictest0-21swapper/209:45:322
4084434992618,4cyclictest0-21swapper/208:10:012
4084434992617,5cyclictest0-21swapper/209:00:012
4084434992616,7cyclictest4149932-21cat10:20:012
4084429992620,4cyclictest4168580-21kworker/u8:1+events_unbound11:52:211
4084429992620,4cyclictest4119084-21kworker/u8:2+events_unbound08:50:151
4084429992620,4cyclictest4118544-21switchtime08:45:281
4084429992619,5cyclictest4163790-21kworker/u8:0+events_unbound11:00:201
4084429992619,5cyclictest4115523-21kworker/u8:1+events_unbound08:42:301
4084429992617,4cyclictest0-21swapper/111:15:211
4084429992617,3cyclictest0-21swapper/110:55:191
408442599269,6cyclictest11-21ksoftirqd/012:10:210
408442599268,10cyclictest11-21ksoftirqd/008:50:230
4084425992620,4cyclictest4068244-21kworker/u8:1+events_unbound07:21:070
4084425992618,5cyclictest4155593-21if_eth110:35:260
4084425992618,4cyclictest0-21swapper/012:15:290
4084425992617,7cyclictest4142752-21kworker/u8:0+events_unbound10:14:100
408443899259,8cyclictest0-21swapper/307:31:063
4084438992519,3cyclictest0-21swapper/309:30:313
4084438992518,4cyclictest0-21swapper/310:05:353
4084438992517,4cyclictest0-21swapper/311:30:003
4084438992517,4cyclictest0-21swapper/311:29:593
4084438992516,5cyclictest0-21swapper/308:50:183
4084434992519,3cyclictest0-21swapper/211:39:592
4084434992519,3cyclictest0-21swapper/207:30:002
4084434992518,4cyclictest0-21swapper/210:00:332
4084434992518,4cyclictest0-21swapper/210:00:332
4084434992518,3cyclictest0-21swapper/211:10:212
4084434992517,4cyclictest4125996-21auditctl09:10:002
408442999259,7cyclictest24-21ksoftirqd/109:14:051
4084429992520,3cyclictest4084419-21cyclictest07:55:181
4084429992519,4cyclictest4064506-21kworker/u8:2+events_unbound07:12:161
4084429992519,4cyclictest4064506-21kworker/u8:2+events_unbound07:12:161
4084429992517,5cyclictest0-21swapper/111:20:181
4084429992517,5cyclictest0-21swapper/111:20:171
408442599257,10cyclictest11-21ksoftirqd/007:30:190
4084425992521,2cyclictest13550irq/42-30be0000.ethernet08:30:150
4084425992519,3cyclictest0-21swapper/011:49:590
4084425992517,4cyclictest0-21swapper/009:20:310
408443899246,10cyclictest4163790-21kworker/u8:0+events_unbound11:22:393
408443899246,10cyclictest4163790-21kworker/u8:0+events_unbound11:22:393
4084438992418,4cyclictest0-21swapper/310:00:343
4084438992418,4cyclictest0-21swapper/310:00:343
4084438992418,3cyclictest0-21swapper/312:20:253
4084438992414,7cyclictest0-21swapper/308:25:283
4084438992410,11cyclictest381rcuc/308:40:013
4084434992418,4cyclictest4131125-21idleruntime-cro09:25:002
4084434992417,3cyclictest0-21swapper/210:45:302
4084434992416,4cyclictest0-21swapper/212:20:302
4084434992416,4cyclictest0-21swapper/211:20:212
4084434992416,4cyclictest0-21swapper/211:20:202
408443499241,3cyclictest41039902date08:05:022
408442999246,4cyclictest221rcuc/110:20:021
408442599249,6cyclictest11-21ksoftirqd/007:45:170
4084425992417,5cyclictest4163790-21kworker/u8:0+events_unbound11:19:410
4084425992417,5cyclictest4127374-21kworker/u8:3+events_unbound10:22:410
408442599241,4cyclictest4090424-21df_inode07:25:160
4084438992317,3cyclictest0-21swapper/311:10:193
4084438992317,3cyclictest0-21swapper/308:14:593
4084438992317,3cyclictest0-21swapper/308:14:593
4084438992317,3cyclictest0-21swapper/307:50:343
4084438992316,5cyclictest4168580-21kworker/u8:1+events_unbound11:50:113
4084434992317,3cyclictest0-21swapper/209:40:312
4084434992316,3cyclictest0-21swapper/211:05:212
4084434992315,5cyclictest4134602-21idleruntime-cro09:35:012
4084434992310,9cyclictest215-21dbus-daemon09:12:332
4084425992314,4cyclictest151rcuc/010:04:150
4084425992314,4cyclictest151rcuc/010:04:150
408442599230,3cyclictest131rcu_preempt10:45:150
4084438992215,5cyclictest4127374-21kworker/u8:3+events_unbound11:30:353
4084438992212,7cyclictest4113165-21ntpq08:30:253
4084434992216,3cyclictest0-21swapper/208:45:262
4084434992216,3cyclictest0-21swapper/208:30:182
4084434992216,3cyclictest0-21swapper/208:15:222
4084434992214,4cyclictest4107261-21cut08:15:002
4084434992214,4cyclictest4107261-21cut08:15:002
4084434992214,4cyclictest0-21swapper/211:50:282
408442999224,8cyclictest4091346-21tail07:25:401
4084429992216,3cyclictest0-21swapper/107:15:021
4084429992216,3cyclictest0-21swapper/107:15:021
408443899216,9cyclictest131rcu_preempt12:34:583
408443499216,3cyclictest131rcu_preempt10:50:162
4084434992115,3cyclictest0-21swapper/212:00:182
4084434992115,3cyclictest0-21swapper/211:25:202
4084434992115,3cyclictest0-21swapper/211:25:202
408443499208,8cyclictest1-21systemd08:27:312
4084434992014,4cyclictest4095846-21irqstats07:40:272
4084434992014,4cyclictest4095846-21irqstats07:40:272
4084434992014,3cyclictest4100780-21fschecks_time07:55:172
4084434992014,3cyclictest0-21swapper/209:35:312
4084434992013,5cyclictest4159873-21kworker/u8:2+events_unbound10:57:502
4084434992012,5cyclictest0-21swapper/212:31:232
4084434991914,3cyclictest4151991-21sh10:25:202
4084434991913,3cyclictest0-21swapper/209:00:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional