You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-06 - 08:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec

ARM Freescale i.MX8M Plus @1600 MHz, Linux 5.17.0-rt15 (Profile)

Latency plot of shadow in rack #b, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q done
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s (updated Wed Jul 06, 2022 00:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3046447996538,18cyclictest3074383-21cron20:30:012
3046450996444,16cyclictest3134265-21sh23:25:003
3046450996444,16cyclictest3134265-21sh23:24:593
3046442994837,9cyclictest231ktimers/123:05:131
3046450994723,17cyclictest0-21swapper/320:55:243
3046447994716,13cyclictest3065495-21taskset20:01:242
3046442994740,5cyclictest3075974-21kworker/u8:2+events_unbound20:41:141
3046447994518,9cyclictest3071070-21latency_hist20:20:012
3046447994516,11cyclictest3090469-21date21:15:212
3046442994525,10cyclictest131rcu_preempt22:44:321
304645099448,3cyclictest0-21swapper/323:30:153
3046450994421,21cyclictest391ktimers/300:20:123
3046450994415,25cyclictest0-21swapper/322:05:273
304645099441,11cyclictest3152048-21memory00:15:203
3046447994429,11cyclictest3076842-21/usr/sbin/munin20:35:202
3046447994419,9cyclictest3098105-21chrt21:38:242
3046447994416,10cyclictest3048119-21date19:15:012
3046442994437,4cyclictest3070979-21grep20:20:001
3046442994423,12cyclictest131rcu_preempt23:40:001
3046450994335,4cyclictest3151358-21cron00:15:003
304645099431,8cyclictest3085378-21tr21:00:203
304645099431,8cyclictest3085378-21tr21:00:203
304645099431,12cyclictest3147971-21idleruntime-cro00:05:013
304645099431,10cyclictest3093375-21/usr/sbin/munin21:25:193
3046447994328,11cyclictest3122643-21/usr/sbin/munin22:50:142
3046447994327,11cyclictest3141430-21/usr/sbin/munin23:45:152
3046447994314,9cyclictest3138458-21ntp_states23:35:222
3046439994336,4cyclictest3139383-21sendmail23:40:010
3046439994334,5cyclictest3094853-21ls21:30:010
304645099422,12cyclictest3099477-21grep21:40:243
304645099422,12cyclictest3082441-21unixbench_multi20:50:253
304645099421,9cyclictest3126503-21tr23:00:193
3046450994216,21cyclictest0-21swapper/322:20:003
3046450994213,4cyclictest3097796-21tail21:35:253
304645099421,10cyclictest3053355-21grep19:25:273
3046447994229,8cyclictest3057521-21/usr/sbin/munin19:40:132
3046447994228,10cyclictest3093665-21/usr/sbin/munin21:25:162
3046442994235,5cyclictest3123908-21kworker/u8:1+events_unbound23:21:331
3046442994235,5cyclictest3123908-21kworker/u8:1+events_unbound23:21:321
3046442994230,9cyclictest3067499-21idleruntime-cro20:10:011
304645099417,6cyclictest3159842-21seq00:39:073
304645099413,11cyclictest3121187-21/usr/sbin/munin22:45:173
304645099412,12cyclictest3079508-21apt20:45:013
3046447994130,7cyclictest3143135-21/usr/sbin/munin23:50:202
3046447994130,7cyclictest3099011-21/usr/sbin/munin21:40:202
3046447994128,7cyclictest3117893-21/usr/sbin/munin22:35:202
3046447994127,11cyclictest3147249-21/usr/sbin/munin00:00:252
3046447994127,11cyclictest3080813-21/usr/sbin/munin20:45:252
3046447994127,10cyclictest3155568-21/usr/sbin/munin00:25:192
3046447994121,16cyclictest3074624-21runrttasks20:30:122
3046447994114,9cyclictest3114546-21ntp_states22:25:222
3046439994133,4cyclictest3048256-21munin-node19:15:000
3046439994131,6cyclictest3139154-21kworker/u8:2+events_unbound23:41:340
304645099407,10cyclictest215-21dbus-daemon23:51:343
304645099402,6cyclictest3103350-21cron21:55:003
304645099402,5cyclictest3074382-21cron20:30:003
304645099401,8cyclictest3125719-21cron23:00:013
3046450994012,4cyclictest0-21swapper/319:45:363
3046447994029,8cyclictest3101260-21/usr/sbin/munin21:45:252
3046447994029,7cyclictest3148719-21/usr/sbin/munin00:05:202
3046447994029,7cyclictest3132914-21/usr/sbin/munin23:20:152
3046447994029,7cyclictest3132914-21/usr/sbin/munin23:20:152
3046447994029,7cyclictest3131414-21/usr/sbin/munin23:15:182
3046447994029,7cyclictest3124600-21/usr/sbin/munin22:55:182
3046447994028,8cyclictest3071403-21/usr/sbin/munin20:20:162
3046447994028,8cyclictest3066028-21/usr/sbin/munin20:05:122
3046447994027,7cyclictest3086673-21/usr/sbin/munin21:05:162
3046447994026,11cyclictest3135257-21/usr/sbin/munin23:25:242
3046447994026,11cyclictest3049244-21/usr/sbin/munin19:15:182
3046447994023,12cyclictest3108917-21fschecks_time22:10:172
3046447994015,8cyclictest3137734-21cut23:34:592
3046442994033,4cyclictest3064082-21latency_hist20:00:001
3046442994024,5cyclictest3156453-21kworker/u8:3-events_power_efficient00:30:021
304645099399,5cyclictest3140056-21/usr/sbin/munin23:40:183
304645099398,7cyclictest3057975-21tr19:40:193
3046450993929,7cyclictest391ktimers/319:30:123
304645099392,8cyclictest3064542-21fschecks_time20:00:143
304645099392,11cyclictest3091432-21cron21:20:003
304645099392,10cyclictest3071620-21/usr/sbin/munin20:20:193
304645099391,9cyclictest3105072-21sendmail22:00:013
304645099391,6cyclictest3124023-21cron22:55:013
3046450993915,20cyclictest0-21swapper/300:25:233
3046450993915,19cyclictest0-21swapper/321:10:353
3046450993912,5cyclictest3138907-21unixbench_multi23:35:263
304645099391,11cyclictest3069615-21df_inode20:15:163
304645099391,10cyclictest3120181-21grep22:40:243
304645099391,10cyclictest3068014-21sort20:10:163
304645099391,10cyclictest3051671-21head19:20:263
3046447993930,6cyclictest3092710-21unixbench_singl21:20:242
3046447993928,8cyclictest3157058-21/usr/sbin/munin00:30:192
3046447993928,8cyclictest3130349-21/usr/sbin/munin23:10:252
3046447993928,7cyclictest3116211-21/usr/sbin/munin22:30:312
3046447993928,7cyclictest3054652-21/usr/sbin/munin19:30:232
3046447993927,9cyclictest3145428-21/usr/sbin/munin23:55:222
3046447993927,9cyclictest311ktimers/222:20:122
3046447993926,10cyclictest3159703-21sshd00:37:272
3046447993926,10cyclictest3151595-21/usr/sbin/munin00:15:272
3046447993926,10cyclictest3126608-21/usr/sbin/munin23:00:222
3046447993925,10cyclictest3056007-21/usr/sbin/munin19:35:172
3046447993924,10cyclictest3062722-21/usr/sbin/munin19:55:142
3046447993923,12cyclictest3061517-21/usr/sbin/munin19:50:222
3046447993910,19cyclictest0-21swapper/221:55:182
3046442993924,5cyclictest131rcu_preempt21:55:131
304645099388,8cyclictest3112438-21/usr/sbin/munin22:20:173
304645099382,7cyclictest3061456-21tr19:50:203
304645099382,7cyclictest3047639-21grep19:10:243
304645099382,6cyclictest3142771-21cron23:50:003
304645099382,11cyclictest3135527-21head23:25:253
304645099382,10cyclictest3108886-21fschecks_count22:10:153
304645099381,9cyclictest3146348-21latency_hist00:00:013
304645099381,9cyclictest3064101-21sendmail20:00:013
304645099381,8cyclictest3128714-21unixbench_singl23:05:263
3046450993818,16cyclictest0-21swapper/321:20:243
3046450993812,3cyclictest0-21swapper/322:35:143
304645099381,11cyclictest3132580-21awk23:20:003
304645099381,11cyclictest3115799-21/usr/sbin/munin22:30:253
304645099381,10cyclictest3130385-21tail23:10:263
304645099381,10cyclictest3106783-21munin-run22:05:003
304645099381,10cyclictest3100597-21cat21:45:173
3046447993828,7cyclictest3084207-21/usr/sbin/munin20:55:262
3046447993827,7cyclictest3108223-21cron22:07:002
3046447993827,7cyclictest3102565-21/usr/sbin/munin21:50:222
3046447993827,7cyclictest3081778-21/usr/sbin/munin20:50:182
3046447993827,7cyclictest3068135-21/usr/sbin/munin20:10:172
3046447993827,7cyclictest3051204-21/usr/sbin/munin19:20:222
3046447993826,7cyclictest3110819-21/usr/sbin/munin22:15:192
3046447993826,7cyclictest3078377-21/usr/sbin/munin20:40:172
3046447993826,7cyclictest3052461-21/usr/sbin/munin19:25:172
3046447993825,9cyclictest3139888-21/usr/sbin/munin23:40:162
3046447993825,10cyclictest3153991-21/usr/sbin/munin00:20:222
3046447993825,10cyclictest3122159-21cron22:48:002
3046442993831,5cyclictest3070606-21kworker/u8:0+events_unbound21:01:191
3046442993831,5cyclictest3070606-21kworker/u8:0+events_unbound21:01:181
3046442993817,4cyclictest131rcu_preempt00:23:011
304645099373,5cyclictest3077780-21cron20:40:013
304645099372,5cyclictest3087618-21grep21:05:273
304645099371,11cyclictest3148656-21missed_timers00:05:203
3046447993726,8cyclictest3085653-21/usr/sbin/munin21:00:232
3046447993726,8cyclictest3085653-21/usr/sbin/munin21:00:232
3046447993725,8cyclictest3151195-21cron00:13:012
3046442993718,5cyclictest131rcu_preempt19:15:261
3046442993714,10cyclictest131rcu_preempt00:29:501
3046439993730,5cyclictest3026283-21kworker/u8:0+events_unbound19:20:590
3046439993727,7cyclictest3065805-21munin-plugin-st20:05:000
304645099369,5cyclictest391ktimers/319:35:153
304645099361,9cyclictest3114987-21unixbench_multi22:25:263
304645099361,9cyclictest3075618-21grep20:30:243
3046450993615,17cyclictest0-21swapper/300:30:173
3046450993611,3cyclictest3079901-21fschecks_count20:45:153
304645099361,12cyclictest3096547-21apt21:35:013
304645099361,11cyclictest3049351-21meminfo19:15:203
3046447993626,7cyclictest3127798-21/usr/sbin/munin23:05:152
3046447993626,7cyclictest3105940-21/usr/sbin/munin22:00:242
3046447993625,8cyclictest3089349-21users21:10:352
3046447993625,8cyclictest0-21swapper/221:30:132
3046442993630,4cyclictest3137432-21kworker/u8:1+events_unbound00:11:421
3046442993630,4cyclictest3081136-21kworker/u8:1+events_unbound21:11:201
3046442993629,5cyclictest3110478-21kworker/u8:4+events_unbound22:51:291
3046442993621,5cyclictest131rcu_preempt00:40:011
3046439993628,4cyclictest3064070-21cron20:00:000
3046439993625,7cyclictest3108054-21grep22:05:260
3046447993525,8cyclictest3119683-21/usr/sbin/munin22:40:182
3046447993525,7cyclictest3059785-21/usr/sbin/munin19:45:322
3046442993527,4cyclictest0-21swapper/123:10:161
3046442993527,4cyclictest0-21swapper/121:20:011
3046442993521,4cyclictest131rcu_preempt23:50:251
3046442993515,4cyclictest131rcu_preempt00:09:211
3046442993515,4cyclictest0-21swapper/123:26:041
3046439993525,7cyclictest0-21swapper/000:00:010
3046439993523,8cyclictest3084627-21sendmail21:00:000
3046442993427,4cyclictest3053338-21unixbench_multi19:25:261
3046442993423,7cyclictest231ktimers/119:45:361
3046442993423,4cyclictest131rcu_preempt23:30:041
3046442993421,5cyclictest131rcu_preempt23:00:251
3046442993417,5cyclictest131rcu_preempt19:40:181
3046439993425,4cyclictest0-21swapper/021:10:340
304643999340,5cyclictest131rcu_preempt00:10:110
3046442993326,5cyclictest3046590-21kworker/u8:3+events_unbound19:13:101
3046442993319,5cyclictest3057040-21kworker/u8:2+events_unbound20:03:191
3046442993319,4cyclictest131rcu_preempt21:29:001
3046442993318,6cyclictest3108153-21kworker/u8:0+events_unbound22:09:291
3046442993318,4cyclictest131rcu_preempt19:30:241
3046442993317,9cyclictest131rcu_preempt21:38:231
3046442993313,5cyclictest131rcu_preempt20:30:141
3046442993313,12cyclictest131rcu_preempt20:35:241
3046442993313,10cyclictest131rcu_preempt21:05:161
3046442993311,14cyclictest24-21ksoftirqd/121:45:181
3046442993310,15cyclictest131rcu_preempt21:40:221
3046439993326,5cyclictest3094761-21kworker/u8:2+events_unbound22:01:250
3046442993223,7cyclictest3146132-21kworker/u8:3+events_unbound00:01:091
3046442993222,6cyclictest0-21swapper/119:50:141
3046442993221,7cyclictest3074383-21cron20:30:011
3046442993217,4cyclictest131rcu_preempt22:20:211
3046442993216,5cyclictest131rcu_preempt22:25:241
3046442993215,4cyclictest131rcu_preempt19:20:301
3046442993215,3cyclictest131rcu_preempt22:15:301
3046442993211,5cyclictest131rcu_preempt23:00:011
3046442993210,10cyclictest24-21ksoftirqd/120:25:011
3046442993124,5cyclictest3098090-21kworker/u8:3+events_unbound21:52:131
3046442993123,4cyclictest0-21swapper/123:45:251
3046442993120,3cyclictest131rcu_preempt23:57:451
3046442993115,5cyclictest131rcu_preempt23:15:131
3046442993114,5cyclictest131rcu_preempt00:16:461
3046442993114,4cyclictest131rcu_preempt20:45:411
3046442993112,4cyclictest131rcu_preempt19:38:181
3046442993111,13cyclictest24-21ksoftirqd/121:30:141
3046439993123,4cyclictest0-21swapper/020:40:010
3046439993123,4cyclictest0-21swapper/020:20:010
304643999311,4cyclictest3120626-21cron22:45:010
3046439993114,14cyclictest11-21ksoftirqd/021:40:110
304645099301,10cyclictest3067501-21munin-plugin-st20:10:003
304644299308,14cyclictest24-21ksoftirqd/122:35:161
3046442993014,9cyclictest131rcu_preempt23:40:181
3046442993014,4cyclictest131rcu_preempt20:59:361
3046442993011,4cyclictest131rcu_preempt21:20:311
3046439993015,10cyclictest215-21dbus-daemon19:35:590
304644299293,6cyclictest24-21ksoftirqd/122:30:291
3046442992910,4cyclictest0-21swapper/120:15:021
3046439992923,4cyclictest3098090-21kworker/u8:3+events_unbound22:16:260
3046442992811,4cyclictest131rcu_preempt22:11:571
3046442992810,4cyclictest131rcu_preempt22:00:141
3046439992818,6cyclictest3091591-21grep21:20:010
3046439992813,13cyclictest11-21ksoftirqd/022:55:110
304643999280,3cyclictest131rcu_preempt00:15:120
3046439992721,4cyclictest3152937-21kworker/u8:1+events_unbound00:31:450
3046439992720,5cyclictest3059034-21latency_hist19:45:020
3046439992720,5cyclictest151rcuc/020:10:130
3046439992719,4cyclictest0-21swapper/023:55:000
3046439992719,4cyclictest0-21swapper/021:35:250
3046439992718,6cyclictest3127446-21auditctl23:05:000
3046439992718,5cyclictest0-21swapper/023:05:260
3046439992717,7cyclictest3101663-21idleruntime-cro21:50:000
3046439992620,3cyclictest0-21swapper/022:55:010
3046439992619,5cyclictest3052051-21kworker/u8:3+events_unbound19:33:100
3046439992618,4cyclictest0-21swapper/020:31:110
3046439992519,4cyclictest13550irq/42-30be0000.ethernet21:30:130
3046439992517,5cyclictest0-21swapper/021:55:250
3046439992517,4cyclictest0-21swapper/000:05:010
304643999251,20cyclictest0-21swapper/022:38:510
3046439992418,4cyclictest3123908-21kworker/u8:1+events_unbound23:26:320
3046439992417,4cyclictest0-21swapper/022:20:260
3046439992417,4cyclictest0-21swapper/020:25:250
3046439992416,5cyclictest0-21swapper/000:25:150
3046439992414,6cyclictest3087602-21grep21:05:270
304643999241,19cyclictest0-21swapper/021:54:060
304643999241,19cyclictest0-21swapper/019:16:030
3046439992317,3cyclictest0-21swapper/022:14:590
3046439992316,3cyclictest0-21swapper/023:23:200
3046439992316,3cyclictest0-21swapper/023:23:200
3046439992315,6cyclictest3152937-21kworker/u8:1+events_unbound00:20:140
3046439992315,5cyclictest0-21swapper/023:10:260
3046439992314,5cyclictest0-21swapper/019:25:420
304643999231,3cyclictest3121425-21ntp_states22:45:210
304643999231,20cyclictest0-21swapper/020:42:400
304643999231,18cyclictest0-21swapper/023:16:450
304643999231,18cyclictest0-21swapper/022:30:420
304643999231,18cyclictest0-21swapper/021:22:250
304643999231,18cyclictest0-21swapper/020:47:180
304643999231,18cyclictest0-21swapper/000:05:380
304643999230,19cyclictest0-21swapper/023:31:170
304643999230,19cyclictest0-21swapper/020:24:000
304643999230,19cyclictest0-21swapper/019:49:280
3046439992215,3cyclictest0-21swapper/019:50:250
304643999221,17cyclictest0-21swapper/020:54:310
304643999220,18cyclictest0-21swapper/021:00:420
304643999220,18cyclictest0-21swapper/021:00:420
304643999220,18cyclictest0-21swapper/020:06:030
3046439992115,2cyclictest0-21swapper/023:45:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional