You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-20 - 18:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec

ARM Freescale i.MX8M Plus @1600 MHz, Linux 5.17.0-rt15 (Profile)

Latency plot of shadow in rack #b, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q done
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackbslot5s (updated Mon Mar 20, 2023 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2488304995141,6cyclictest2579351-21grep11:30:371
2488312995043,4cyclictest2560934-21sendmail10:40:003
2488304994940,5cyclictest1-21systemd11:10:011
2488299994831,6cyclictest2514199-21kworker/u8:2+events_unbound08:33:390
248830499468,5cyclictest131rcu_preempt08:05:121
248829999446,4cyclictest131rcu_preempt09:50:200
2488299994435,6cyclictest296-21systemd-logind10:12:240
2488299994432,7cyclictest2585631-21ntpq11:50:270
2488299994423,6cyclictest2516008-21kworker/u8:0+events_unbound08:35:400
2488308994332,7cyclictest2554128-21sendmail10:20:002
2488304994326,7cyclictest2560805-21kworker/u8:1+events_unbound10:44:331
2488304994326,7cyclictest2560805-21kworker/u8:1+events_unbound10:44:331
2488312994232,6cyclictest2527914-21grep09:00:273
2488308994234,5cyclictest2562646-21munin-plugin-st10:45:012
2488308994234,5cyclictest2562646-21munin-plugin-st10:45:002
2488304994236,4cyclictest2528632-21kworker/u8:2+events_unbound09:19:511
2488304994234,4cyclictest2564346-21idleruntime-cro10:50:001
2488299994229,9cyclictest2572918-21apt-config11:15:010
2488312994130,6cyclictest0-21swapper/312:40:003
2488312994128,10cyclictest435-21cron08:55:003
2488308994132,6cyclictest2579730-21cron11:35:012
2488304994131,4cyclictest0-21swapper/109:00:011
2488304994130,8cyclictest2584855-21idleruntime-cro11:50:001
2488299994133,4cyclictest0-21swapper/009:05:010
2488299994132,6cyclictest2579354-21unixbench_singl11:30:370
2488312994031,5cyclictest2512836-21cron08:20:003
2488308994029,7cyclictest2569049-21grep11:00:362
2488304994032,5cyclictest2596783-21cron12:25:001
2488299994032,5cyclictest121ktimers/008:40:120
2488299994031,4cyclictest0-21swapper/010:50:000
2488308993928,7cyclictest0-21swapper/211:20:002
2488308993926,8cyclictest0-21swapper/208:45:312
2488308993926,7cyclictest2586092-21grep11:50:312
2488304993931,4cyclictest0-21swapper/111:00:011
2488299993931,6cyclictest2470187-21kworker/u8:1+events_unbound07:24:260
2488299993930,5cyclictest2575934-21grep11:20:270
248829999392,9cyclictest11-21ksoftirqd/008:05:120
2488312993829,4cyclictest0-21swapper/308:30:173
2488304993831,5cyclictest2548928-21kworker/u8:0+events_unbound10:09:561
2488304993830,4cyclictest2587797-21unixbench_multi11:55:271
2488304993827,7cyclictest0-21swapper/111:50:261
2488304993826,8cyclictest2491768-21grep07:15:301
2488299993832,3cyclictest0-21swapper/012:40:000
2488299993830,4cyclictest2569457-21munin-plugin-st11:05:010
2488312993730,4cyclictest2581153-21kworker/u8:0-events_unbound11:55:263
2488312993728,6cyclictest2597211-21fschecks_time12:25:233
2488312993727,5cyclictest0-21swapper/311:10:233
2488308993730,4cyclictest2596787-21sh12:25:002
2488308993726,6cyclictest0-21swapper/211:15:012
2488304993731,4cyclictest2502833-21kworker/u8:3+events_unbound08:39:421
2488304993729,4cyclictest0-21swapper/112:20:001
2488299993730,4cyclictest2566038-21sh10:55:000
2488299993730,4cyclictest2516250-21sh08:30:000
2488299993727,6cyclictest2512419-21grep08:15:270
2488299993727,6cyclictest0-21swapper/011:00:010
2488312993626,6cyclictest0-21swapper/311:15:283
2488304993630,4cyclictest2495333-21kworker/u8:2+events_unbound07:34:271
2488304993623,5cyclictest2552197-21kworker/u8:3+events_unbound10:53:581
2488304993621,6cyclictest2500395-21kworker/u8:0+events_unbound08:19:501
2488299993626,5cyclictest0-21swapper/007:14:240
2488299993618,5cyclictest131rcu_preempt11:15:140
2488312993527,5cyclictest2501234-21fschecks_count07:45:173
2488312993527,5cyclictest2501234-21fschecks_count07:45:173
2488312993527,4cyclictest0-21swapper/307:40:163
2488312993526,5cyclictest2506021-21cron08:00:003
2488312993525,6cyclictest0-21swapper/312:30:293
2488312993521,4cyclictest0-21swapper/310:49:593
2488308993528,4cyclictest2601873-21cron12:40:002
2488308993527,4cyclictest0-21swapper/207:40:012
2488304993528,3cyclictest0-21swapper/111:10:351
2488304993527,6cyclictest2514199-21kworker/u8:2+events_unbound08:24:381
2488304993526,6cyclictest2593733-21kworker/u8:2+events_unbound12:35:281
2488304993526,5cyclictest0-21swapper/111:30:001
2488304993525,6cyclictest0-21swapper/111:40:001
2488304993517,8cyclictest2582998-21kworker/u8:1+events_unbound12:07:001
248831299347,5cyclictest131rcu_preempt07:30:133
2488312993425,5cyclictest2567274-21unixbench_multi10:55:303
2488312993425,4cyclictest0-21swapper/311:40:173
2488312993424,6cyclictest2591678-21munin-plugin-st12:10:003
2488312993424,6cyclictest0-21swapper/311:50:263
2488312993423,6cyclictest0-21swapper/309:00:013
2488308993426,4cyclictest0-21swapper/212:25:232
2488308993423,7cyclictest2530098-21sh09:10:012
2488308993423,7cyclictest2530098-21sh09:10:002
2488304993427,5cyclictest2554048-21kworker/u8:0+events_unbound10:29:591
2488304993426,4cyclictest0-21swapper/109:40:011
2488299993412,13cyclictest11-21ksoftirqd/009:40:350
2488299993412,13cyclictest11-21ksoftirqd/009:40:350
2488312993325,4cyclictest0-21swapper/310:40:303
2488312993325,4cyclictest0-21swapper/310:40:303
2488312993324,5cyclictest2535229-21grep09:25:003
2488308993325,4cyclictest0-21swapper/209:50:372
2488304993316,10cyclictest2514199-21kworker/u8:2-events_freezable_power_08:33:351
2488299993326,3cyclictest0-21swapper/010:40:300
2488299993326,3cyclictest0-21swapper/010:40:300
2488299993325,4cyclictest0-21swapper/007:30:010
2488299993311,15cyclictest11-21ksoftirqd/012:20:280
2488312993224,4cyclictest0-21swapper/312:20:193
2488312993223,4cyclictest0-21swapper/309:45:193
2488312993221,8cyclictest391ktimers/308:35:133
2488308993224,4cyclictest0-21swapper/209:35:012
2488308993224,4cyclictest0-21swapper/207:55:292
2488308993222,7cyclictest2545981-21fschecks_count09:55:172
2488304993226,4cyclictest2552197-21kworker/u8:3+events_unbound11:00:021
2488304993226,3cyclictest0-21swapper/109:50:001
2488304993225,4cyclictest0-21swapper/112:10:341
2488304993224,5cyclictest2540834-21fschecks_count09:40:221
2488304993224,5cyclictest2540834-21fschecks_count09:40:221
2488304993224,5cyclictest2518216-21kworker/u8:1+events_unbound08:45:371
2488304993223,5cyclictest0-21swapper/111:20:001
248830499321,6cyclictest0-21swapper/109:25:131
248830499321,18cyclictest2488446-21runrttasks07:10:041
248829999323,10cyclictest11-21ksoftirqd/012:00:170
2488299993226,4cyclictest2521201-21kworker/u8:2+events_unbound08:59:460
2488299993224,4cyclictest0-21swapper/007:55:010
2488299993224,4cyclictest0-21swapper/007:55:010
2488299993214,6cyclictest131rcu_preempt08:50:110
2488312993123,4cyclictest0-21swapper/307:15:313
2488312993122,5cyclictest0-21swapper/309:25:173
2488312993114,4cyclictest131rcu_preempt07:39:143
2488304993125,4cyclictest2470187-21kworker/u8:1+events_unbound07:41:391
2488304993124,5cyclictest2470187-21kworker/u8:1+events_unbound07:49:281
2488304993124,5cyclictest2470187-21kworker/u8:1+events_unbound07:49:281
2488304993124,4cyclictest0-21swapper/107:40:011
2488304993124,3cyclictest0-21swapper/108:30:001
2488304993121,6cyclictest0-21swapper/110:00:311
2488304993114,11cyclictest0-21swapper/108:40:251
2488304993110,11cyclictest0-21swapper/108:53:541
248829999317,15cyclictest11-21ksoftirqd/010:25:270
248829999313,6cyclictest11-21ksoftirqd/012:05:190
2488299993123,4cyclictest0-21swapper/009:45:290
2488299993123,4cyclictest0-21swapper/008:10:260
2488299993123,4cyclictest0-21swapper/008:10:260
248829999311,7cyclictest11-21ksoftirqd/011:25:140
2488312993022,4cyclictest0-21swapper/311:05:303
2488312993019,6cyclictest0-21swapper/310:30:303
2488308993023,4cyclictest0-21swapper/210:45:342
2488308993023,3cyclictest0-21swapper/208:50:222
2488308993021,6cyclictest2534484-21cut09:20:262
2488308993021,6cyclictest0-21swapper/210:55:202
2488304993021,6cyclictest2547328-21grep10:00:011
2488304993016,6cyclictest2502833-21kworker/u8:3+events_unbound07:53:491
2488304993016,6cyclictest2502833-21kworker/u8:3+events_unbound07:53:491
248829999307,14cyclictest131rcu_preempt07:40:260
2488299993024,4cyclictest2565790-21kworker/u8:2+events_unbound11:55:280
2488299993024,3cyclictest0-21swapper/011:40:010
2488299993021,5cyclictest2560442-21grep10:35:290
2488308992921,4cyclictest2519717-21cron08:40:012
2488308992920,6cyclictest2580201-21grep11:35:172
2488308992920,6cyclictest0-21swapper/207:10:272
248830499299,10cyclictest0-21swapper/109:02:581
2488304992923,4cyclictest2535035-21kworker/u8:1+events_unbound09:34:521
248829999297,5cyclictest131rcu_preempt11:05:300
248829999296,13cyclictest11-21ksoftirqd/012:10:230
2488299992923,4cyclictest2545416-21kworker/u8:3+events_unbound10:02:380
2488299992922,4cyclictest0-21swapper/007:35:270
2488299992920,3cyclictest131rcu_preempt12:25:340
248831299288,10cyclictest2518216-21kworker/u8:1+events_unbound08:42:253
2488312992820,4cyclictest0-21swapper/308:14:343
2488312992820,4cyclictest0-21swapper/308:14:343
2488312992820,4cyclictest0-21swapper/307:20:283
2488312992819,5cyclictest0-21swapper/310:00:313
2488312992817,8cyclictest2593375-21basename12:15:013
2488312992817,7cyclictest0-21swapper/310:50:313
2488312992817,7cyclictest0-21swapper/309:20:003
2488308992820,4cyclictest0-21swapper/209:00:012
2488308992813,12cyclictest2488292-21cyclictest10:35:152
248830499289,4cyclictest2516008-21kworker/u8:0+events_freezable_power_09:05:281
248830499289,4cyclictest2516008-21kworker/u8:0+events_freezable_power_09:05:281
2488304992821,4cyclictest0-21swapper/110:10:251
248830499281,15cyclictest0-21swapper/110:20:201
2488304992811,3cyclictest131rcu_preempt07:21:021
248830499281,10cyclictest0-21swapper/108:00:321
248829999289,3cyclictest131rcu_preempt09:25:170
248829999286,15cyclictest11-21ksoftirqd/007:15:220
248829999286,13cyclictest11-21ksoftirqd/010:35:010
248829999284,13cyclictest11-21ksoftirqd/009:40:010
2488299992821,4cyclictest0-21swapper/010:20:290
2488299992821,4cyclictest0-21swapper/009:20:280
2488299992819,6cyclictest2532425-21ls09:15:240
2488299992817,7cyclictest2599746-21grep12:30:310
2488299992813,3cyclictest0-21swapper/011:45:310
2488299992812,3cyclictest131rcu_preempt08:00:260
248829999281,12cyclictest0-21swapper/008:49:180
2488312992721,4cyclictest2573154-21kworker/u8:4+events_unbound11:37:373
2488312992720,3cyclictest0-21swapper/311:25:003
2488312992720,3cyclictest0-21swapper/310:15:013
2488312992719,4cyclictest0-21swapper/311:30:253
2488312992717,6cyclictest0-21swapper/309:45:013
2488312992717,6cyclictest0-21swapper/309:45:013
2488312992716,8cyclictest2516283-21apt-key08:30:003
248831299271,12cyclictest0-21swapper/307:10:023
2488308992719,4cyclictest0-21swapper/209:45:002
2488308992719,4cyclictest0-21swapper/209:45:002
2488308992718,5cyclictest2512358-21unixbench_multi08:15:262
2488308992718,5cyclictest0-21swapper/209:10:182
2488308992718,5cyclictest0-21swapper/209:10:182
248830499279,6cyclictest24-21ksoftirqd/108:10:231
248830499279,6cyclictest24-21ksoftirqd/108:10:231
248830499278,11cyclictest24-21ksoftirqd/110:30:291
2488304992720,4cyclictest0-21swapper/111:40:271
2488304992720,4cyclictest0-21swapper/109:50:251
2488304992720,3cyclictest0-21swapper/111:20:191
2488304992714,5cyclictest2500395-21kworker/u8:0+events_unbound07:58:221
248830499271,15cyclictest0-21swapper/112:33:321
248830499271,10cyclictest0-21swapper/109:20:201
248829999277,3cyclictest131rcu_preempt09:10:140
248829999277,3cyclictest131rcu_preempt09:10:140
248829999277,13cyclictest11-21ksoftirqd/012:15:210
248829999275,5cyclictest151rcuc/007:46:150
248829999275,5cyclictest151rcuc/007:46:150
2488299992720,4cyclictest0-21swapper/009:05:210
2488299992720,4cyclictest0-21swapper/009:05:210
248829999271,6cyclictest0-21swapper/009:55:120
2488299992712,12cyclictest2513241-21fschecks_count08:20:200
2488312992620,4cyclictest2500395-21kworker/u8:0+events_unbound08:04:313
2488312992618,4cyclictest2545583-21sh09:55:003
2488312992618,4cyclictest0-21swapper/312:15:283
2488312992618,4cyclictest0-21swapper/311:25:173
2488312992617,4cyclictest0-21swapper/309:35:303
2488312992614,8cyclictest2495147-21cat07:25:263
2488308992620,3cyclictest0-21swapper/207:50:012
2488308992620,3cyclictest0-21swapper/207:50:012
2488308992619,4cyclictest2495655-21kthreadd07:30:012
2488308992619,4cyclictest0-21swapper/211:05:312
2488308992618,5cyclictest0-21swapper/212:15:282
2488308992617,5cyclictest0-21swapper/210:25:272
2488308992617,5cyclictest0-21swapper/207:50:262
2488308992617,5cyclictest0-21swapper/207:50:262
2488308992616,7cyclictest2551565-21grep10:10:252
2488308992616,7cyclictest2521443-21idleruntime-cro08:45:012
2488304992620,4cyclictest2581153-21kworker/u8:0+events_unbound12:00:271
2488304992616,4cyclictest131rcu_preempt12:28:271
248830499261,14cyclictest0-21swapper/110:39:331
248830499261,14cyclictest0-21swapper/109:14:591
248830499261,14cyclictest0-21swapper/109:14:591
248829999260,15cyclictest0-21swapper/009:30:320
2488312992518,4cyclictest0-21swapper/310:15:243
2488312992515,7cyclictest0-21swapper/310:25:263
2488312992514,6cyclictest0-21swapper/309:30:323
2488312992514,6cyclictest0-21swapper/307:50:263
2488312992514,6cyclictest0-21swapper/307:50:263
2488312992512,9cyclictest40-21ksoftirqd/312:00:303
2488308992518,4cyclictest0-21swapper/212:10:332
2488308992518,3cyclictest0-21swapper/212:05:002
2488308992518,3cyclictest0-21swapper/211:45:342
2488308992517,5cyclictest311ktimers/212:35:002
2488308992517,5cyclictest0-21swapper/211:55:272
2488308992517,5cyclictest0-21swapper/210:10:002
2488308992517,4cyclictest0-21swapper/209:40:012
2488308992516,5cyclictest0-21swapper/208:00:252
2488308992514,8cyclictest2590295-21awk12:05:202
2488308992512,7cyclictest0-21swapper/208:25:282
2488304992518,5cyclictest2535035-21kworker/u8:1+events_unbound10:17:051
248829999251,4cyclictest2549238-21apt-get10:05:140
2488299992511,4cyclictest0-21swapper/011:41:520
248829999251,14cyclictest0-21swapper/010:17:100
2488299992510,9cyclictest11-21ksoftirqd/007:35:020
2488312992418,4cyclictest2565790-21kworker/u8:2+events_unbound11:02:273
2488312992418,4cyclictest2535035-21kworker/u8:1+events_unbound10:05:523
2488312992418,4cyclictest2528632-21kworker/u8:2+events_unbound09:06:243
2488312992418,4cyclictest2528632-21kworker/u8:2+events_unbound09:06:243
2488312992417,5cyclictest2516008-21kworker/u8:0+events_unbound08:46:533
2488312992416,5cyclictest0-21swapper/308:25:003
2488308992418,3cyclictest0-21swapper/209:15:282
2488308992418,3cyclictest0-21swapper/207:20:272
2488308992417,4cyclictest0-21swapper/209:25:272
2488308992417,4cyclictest0-21swapper/208:10:262
2488308992417,4cyclictest0-21swapper/208:10:262
2488308992416,5cyclictest311ktimers/211:25:252
2488308992416,5cyclictest0-21swapper/207:30:172
2488308992416,4cyclictest0-21swapper/210:50:312
2488308992416,4cyclictest0-21swapper/207:40:262
248830499244,3cyclictest131rcu_preempt07:25:141
2488312992316,4cyclictest0-21swapper/308:05:253
2488312992313,6cyclictest0-21swapper/309:55:273
2488308992315,4cyclictest2558810-21unixbench_singl10:30:312
2488308992314,6cyclictest2582689-21grep11:40:272
248831299226,3cyclictest131rcu_preempt10:21:313
2488312992216,3cyclictest0-21swapper/311:50:003
2488312992216,3cyclictest0-21swapper/309:10:253
2488312992216,3cyclictest0-21swapper/309:10:253
2488308992115,3cyclictest2542420-21/usr/sbin/munin09:45:212
2488308992115,3cyclictest0-21swapper/207:15:312
2488308992015,3cyclictest0-21swapper/208:10:012
2488308992014,3cyclictest2516668-21sh08:30:152
2488308992013,5cyclictest311ktimers/210:20:222
2488308992013,4cyclictest311ktimers/208:22:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional