You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-10-01 - 21:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot2s.osadl.org (updated Sun Oct 01, 2023 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
291350650,0irq/25-eth10-21swapper/307:05:103
2331723425,0sleep20-21swapper/207:04:292
2326123423,0sleep00-21swapper/007:03:470
2345623127,0sleep10-21swapper/107:06:041
339960,0migration/3943-21sh11:25:023
339960,0migration/38996-21sh09:52:313
339960,0migration/38941-21munin-node12:08:453
339960,0migration/38121-21sh10:29:053
339960,0migration/332401-21sh09:26:383
339960,0migration/324610-21sh09:41:153
339960,0migration/324548-21sh10:39:353
28415060,0irq/27-eth0-tx-0-21swapper/212:14:572
28405060,0irq/26-eth0-rx-26588-21df_abs10:43:383
28405060,0irq/26-eth0-rx-25997-21df09:43:343
28405060,0irq/26-eth0-rx-11403-21if_eth011:13:383
28405060,0irq/26-eth0-rx-0-21swapper/310:04:053
249960,0watchdog/230245-21cut12:23:382
237169966,0cyclictest0-21swapper/209:51:542
237169960,0cyclictest0-21swapper/209:31:342
237149960,0cyclictest0-21swapper/011:48:350
19160,0ktimersoftd/124645-21ssh09:22:521
8225050,0irq/24-0000:00:25844-21cat10:23:162
4150,0ktimersoftd/00-21swapper/011:45:160
35150,0ktimersoftd/30-21swapper/312:30:233
339950,0migration/36820-21kthreadcore08:08:333
339950,0migration/327295-21aten_r1power_cu12:03:303
339950,0migration/327087-21munin-node09:03:353
339950,0migration/32236-21kthreadcore09:08:383
339950,0migration/32234-21munin-node11:08:353
339950,0migration/321281-21munin-node07:48:293
339950,0migration/320938-21kthreadcore10:18:343
339950,0migration/319338-21fschecks_count11:38:353
339950,0migration/317533-21timerwakeupswit12:33:433
339950,0migration/313375-21kthreadcore12:13:373
339950,0migration/313186-21kthreadcore10:13:393
339950,0migration/311002-21cpuspeed_turbos11:33:293
28415050,0irq/27-eth0-tx-6206-21munin-node07:28:350
28415050,0irq/27-eth0-tx-24037-21ssh09:59:082
28415050,0irq/27-eth0-tx-0-21swapper/212:19:102
28415050,0irq/27-eth0-tx-0-21swapper/211:55:492
28415050,0irq/27-eth0-tx-0-21swapper/211:44:142
28415050,0irq/27-eth0-tx-0-21swapper/211:29:152
28415050,0irq/27-eth0-tx-0-21swapper/211:25:382
28415050,0irq/27-eth0-tx-0-21swapper/210:57:152
28415050,0irq/27-eth0-tx-0-21swapper/209:46:572
28415050,0irq/27-eth0-tx-0-21swapper/209:35:092
28405050,0irq/26-eth0-rx-5667-21cat11:28:413
28405050,0irq/26-eth0-rx-32294-21ssh10:24:133
28405050,0irq/26-eth0-rx-31036-21cut11:43:373
28405050,0irq/26-eth0-rx-28620-21iostat_ios12:23:373
28405050,0irq/26-eth0-rx-23817-21unixbench_singl09:58:443
28405050,0irq/26-eth0-rx-17262-21munin-run09:38:163
28405050,0irq/26-eth0-rx-15777-21sensors_temp10:33:453
28405050,0irq/26-eth0-rx-0-21swapper/312:19:343
28405050,0irq/26-eth0-rx-0-21swapper/311:49:243
28405050,0irq/26-eth0-rx-0-21swapper/310:57:283
28405050,0irq/26-eth0-rx-0-21swapper/310:51:473
28405050,0irq/26-eth0-rx-0-21swapper/310:11:573
28405050,0irq/26-eth0-rx-0-21swapper/309:54:083
28405050,0irq/26-eth0-rx-0-21swapper/309:32:463
28405050,0irq/26-eth0-rx-0-21swapper/309:18:193
28405050,0irq/26-eth0-rx-0-21swapper/309:16:373
27150,0ktimersoftd/20-21swapper/211:49:032
249950,0watchdog/215802-21kthreadcore07:38:342
249950,0watchdog/20-21swapper/212:33:222
249950,0watchdog/20-21swapper/211:37:062
249950,0watchdog/20-21swapper/210:51:542
249950,0watchdog/20-21swapper/210:30:542
249950,0watchdog/20-21swapper/209:54:262
249950,0watchdog/20-21swapper/209:20:302
249950,0watchdog/20-21swapper/209:13:422
237169955,0cyclictest0-21swapper/211:00:012
237169950,0cyclictest0-21swapper/212:12:042
237169950,0cyclictest0-21swapper/212:08:072
237169950,0cyclictest0-21swapper/212:00:142
237169950,0cyclictest0-21swapper/211:40:512
237169950,0cyclictest0-21swapper/211:14:312
237169950,0cyclictest0-21swapper/211:10:532
237169950,0cyclictest0-21swapper/210:04:502
237159955,0cyclictest0-21swapper/112:32:321
237159955,0cyclictest0-21swapper/111:00:271
237159955,0cyclictest0-21swapper/109:45:441
237159955,0cyclictest0-21swapper/108:08:461
237159950,0cyclictest0-21swapper/112:08:341
237159950,0cyclictest0-21swapper/111:30:061
237149955,0cyclictest0-21swapper/012:01:400
237149954,0cyclictest0-21swapper/012:10:300
237149950,0cyclictest0-21swapper/010:30:140
179950,0migration/17932-21sh09:30:361
179950,0migration/128114-21idleruntime12:03:331
179950,0migration/118176-21sh12:35:021
179950,0migration/116324-21kthreadcore11:53:411
179950,0migration/113032-21kthreadcore09:33:411
169950,0watchdog/126538-21perl10:03:341
169950,0watchdog/118436-21perl10:18:301
149950,0migration/08819-21sh10:50:280
149950,0migration/027701-21aten_r1power_po12:23:310
149950,0migration/024974-21ntp_offset08:58:420
149950,0migration/012076-21kthreadcore10:53:390
149950,0migration/010871-21sh12:32:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional