You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-10 - 19:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sun Nov 10, 2024 12:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1655477994035,3cyclictest1817234-21gpgv09:45:011
1655482992721,4cyclictest1969144-21latency_hist12:10:012
1655482992521,3cyclictest2304165-21systemd-journal09:55:002
1655482992519,4cyclictest1917140-21apt-get11:20:022
1655489992419,3cyclictest1870129-21/usr/sbin/munin10:35:213
1655489992418,4cyclictest1806472-21cat09:35:013
1655482992418,4cyclictest1681137-21latency_hist07:35:002
1655477992420,3cyclictest1890760-21kworker/u8:3+flush-259:011:15:221
1655477992418,4cyclictest1906760-21latency_hist11:10:011
1655474992419,4cyclictest1844027-21/usr/sbin/munin10:10:200
1655489992316,5cyclictest2304165-21systemd-journal08:25:003
1655489992316,5cyclictest1896102-21latency_hist11:00:013
1655482992216,4cyclictest1984588-21latency_hist12:25:012
1655482992216,4cyclictest1806344-21latency_hist09:35:012
1655474992219,2cyclictest1728091-21kworker/u8:2+events_unbound08:20:190
1655474992216,4cyclictest1675992-21latency_hist07:30:000
1655489992116,3cyclictest2000024-21latency_hist12:40:003
1655482992117,3cyclictest1890760-21kworker/u8:3+flush-259:011:30:222
1655482992115,4cyclictest1733519-21apt-get08:25:122
1655482992113,5cyclictest1753894-21latency_hist08:45:012
1655477992114,5cyclictest1712582-21latency_hist08:05:001
1655489992016,3cyclictest1837612-21kworker/u8:3+flush-259:010:25:003
1655489991916,2cyclictest1670889-21munin-run07:25:013
165548299196,6cyclictest1701793-21munin-run07:55:002
1655477991915,2cyclictest0-21swapper/111:35:001
1655477991913,4cyclictest2304165-21systemd-journal11:25:011
1655474991913,4cyclictest2304165-21systemd-journal11:45:000
1655474991912,5cyclictest1664851-21ntpq07:15:200
1655489991814,3cyclictest503-21systemd-logind12:35:003
1655489991814,3cyclictest2304165-21systemd-journal08:05:003
1655482991815,2cyclictest1896792-21irqcore11:00:162
1655477991815,2cyclictest1707008-21systemd-run08:00:001
1655477991813,4cyclictest1759538-21cat08:50:011
1655477991812,4cyclictest1948538-21latency_hist11:50:011
1655474991815,2cyclictest1859172-21cron10:25:000
1655474991815,2cyclictest1817782-21kworker/u8:1+flush-259:010:00:250
1655474991815,2cyclictest1675935-21kworker/u8:1+events_unbound08:55:180
1655474991815,2cyclictest0-21swapper/012:40:000
1655474991813,4cyclictest1890541-21apt-get10:55:010
165547499181,2cyclictest1875054-21turbostat10:40:010
1655477991714,2cyclictest1964195-21kworker/u8:2+flush-259:012:39:591
1655477991712,4cyclictest1770015-21apt-get09:00:131
1655477991712,3cyclictest2304165-21systemd-journal07:23:171
1655477991712,3cyclictest1890562-21https10:55:001
1655477991711,5cyclictest1832163-21ntpq09:55:221
1655477991710,5cyclictest2304165-21systemd-journal07:25:171
1655474991714,2cyclictest60650irq/133-enp0s29f1:rx-011:35:220
1655474991714,2cyclictest60650irq/133-enp0s29f1:rx-010:44:530
1655474991713,3cyclictest1728091-21kworker/u8:2+events_unbound09:10:010
1655474991712,1cyclictest60650irq/133-enp0s29f1:rx-009:25:160
1655489991614,1cyclictest1985289-21irqcore12:25:193
1655489991612,3cyclictest2304165-21systemd-journal08:40:003
1655489991612,3cyclictest1917735-21base6411:20:013
1655489991612,3cyclictest1837612-21kworker/u8:3+flush-259:010:25:183
1655489991612,3cyclictest1675935-21kworker/u8:1+flush-259:008:55:173
165548299169,4cyclictest1859186-21latency_hist10:25:002
1655482991613,2cyclictest1687586-21kthreadcore07:40:182
1655482991613,2cyclictest1659707-21ntp_kernel_pll_07:10:222
1655482991612,3cyclictest506-21in:imuxsock09:20:002
165547799169,5cyclictest1938192-21latency_hist11:40:011
1655477991614,1cyclictest1854076-21latency_hist10:20:001
1655474991613,2cyclictest60650irq/133-enp0s29f1:rx-010:32:430
1655474991613,2cyclictest60650irq/133-enp0s29f1:rx-007:50:230
1655474991613,2cyclictest60650irq/133-enp0s29f1:rx-007:30:230
1655474991613,2cyclictest1675935-21kworker/u8:1+events_unbound07:55:220
1655474991612,3cyclictest506-21in:imuxsock08:30:000
1655474991611,3cyclictest1-21systemd09:15:000
1655489991512,2cyclictest1807004-21kworker/u8:2+events_unbound09:50:003
1655489991511,3cyclictest1748763-21kworker/u8:0+flush-259:009:00:163
1655489991510,4cyclictest1817116-21latency_hist09:45:013
165548299156,8cyclictest1837612-21kworker/u8:3+flush-259:010:30:212
1655482991512,2cyclictest1759066-21systemd-run08:50:002
1655482991512,1cyclictest0-21swapper/211:20:002
1655482991510,4cyclictest1817767-21rred09:45:032
1655477991510,4cyclictest1759021-21apt-get08:50:001
1655477991510,3cyclictest1718033-21apt-get08:10:151
1655474991513,2cyclictest61450irq/134-enp0s29f1:tx-008:45:150
1655474991513,1cyclictest60650irq/133-enp0s29f1:rx-011:25:260
1655474991513,1cyclictest60650irq/133-enp0s29f1:rx-010:58:170
1655474991513,1cyclictest60650irq/133-enp0s29f1:rx-010:05:160
1655474991513,1cyclictest60650irq/133-enp0s29f1:rx-009:52:040
1655474991513,1cyclictest60650irq/133-enp0s29f1:rx-009:44:560
1655474991513,1cyclictest60650irq/133-enp0s29f1:rx-008:40:130
1655474991512,2cyclictest61450irq/134-enp0s29f1:tx-007:20:190
1655474991512,2cyclictest60650irq/133-enp0s29f1:rx-012:30:300
1655474991512,2cyclictest60650irq/133-enp0s29f1:rx-012:10:190
1655474991512,2cyclictest60650irq/133-enp0s29f1:rx-012:05:210
1655474991512,2cyclictest60650irq/133-enp0s29f1:rx-011:05:160
1655474991512,2cyclictest60650irq/133-enp0s29f1:rx-009:37:140
1655474991512,2cyclictest60650irq/133-enp0s29f1:rx-007:11:080
1655474991512,2cyclictest1938741-21kworker/u8:1+flush-259:011:50:200
1655474991512,2cyclictest1686976-21irqcore07:40:170
1655474991511,3cyclictest1879343-21kworker/u8:2+flush-259:011:15:270
1655474991510,4cyclictest509-21rs:main0
1655474991510,3cyclictest862-21sshd08:14:170
1655474991510,3cyclictest2304165-21systemd-journal11:30:180
1655474991510,3cyclictest1681178-21kworker/u8:3+flush-259:007:40:000
165548999149,4cyclictest1927864-21latency_hist11:30:013
165548999149,4cyclictest1807005-21/usr/sbin/munin09:35:143
165548999149,4cyclictest1738653-21/usr/sbin/munin08:30:133
1655489991411,2cyclictest1640108-21kworker/u8:1+flush-259:007:15:013
1655489991411,2cyclictest0-21swapper/310:55:003
1655489991410,3cyclictest1833745-21apt-get10:00:123
1655489991410,3cyclictest1754544-21kworker/u8:3+flush-259:009:05:163
1655482991411,2cyclictest1964195-21kworker/u8:2+flush-259:012:10:222
1655482991411,2cyclictest1875043-21sh10:40:002
1655482991411,2cyclictest1655149-21kworker/u8:2+flush-259:007:20:212
1655482991410,3cyclictest1890760-21kworker/u8:3+flush-259:012:00:262
1655482991410,3cyclictest1691480-21kworker/u8:0+flush-259:007:45:172
1655482991410,2cyclictest0-21swapper/210:00:002
165547799147,5cyclictest1890541-21apt-get10:55:001
1655477991412,1cyclictest1885405-21latency_hist10:50:001
1655477991412,1cyclictest0-21swapper/109:20:001
1655477991411,2cyclictest1951095-21kthreadcore11:50:211
1655477991411,2cyclictest1801168-21idleruntime-cro09:30:001
1655477991411,2cyclictest1664880-21ntp_kernel_pll_07:15:221
165547499149,3cyclictest1978211-21kthreadcore12:15:190
1655474991412,2cyclictest60650irq/133-enp0s29f1:rx-009:55:080
1655474991412,1cyclictest60650irq/133-enp0s29f1:rx-012:20:200
1655474991412,1cyclictest60650irq/133-enp0s29f1:rx-011:46:000
1655474991412,1cyclictest60650irq/133-enp0s29f1:rx-010:25:160
1655474991412,1cyclictest60650irq/133-enp0s29f1:rx-008:15:200
1655474991411,2cyclictest60650irq/133-enp0s29f1:rx-008:38:320
1655474991411,2cyclictest60650irq/133-enp0s29f1:rx-008:34:400
1655474991411,2cyclictest60650irq/133-enp0s29f1:rx-007:45:450
165547499141,11cyclictest2304165-21systemd-journal08:00:010
1655474991410,3cyclictest1896369-21apt-get11:00:110
1655489991311,1cyclictest0-21swapper/310:00:003
1655489991311,1cyclictest0-21swapper/308:15:003
1655489991310,2cyclictest1949221-21irqcore11:50:213
1655489991310,2cyclictest1759221-21gpgconf08:50:013
1655489991310,2cyclictest0-21swapper/311:40:003
1655489991310,2cyclictest0-21swapper/307:30:183
165548299139,3cyclictest1881511-21tr10:45:202
165548299139,2cyclictest0-21swapper/211:30:002
165548299138,4cyclictest1863483-21ntpq10:25:232
165548299138,4cyclictest1707624-21kworker/u8:0+flush-259:008:10:262
165548299138,3cyclictest1890967-21gpgv10:55:002
165548299137,4cyclictest1901247-21apt-get11:05:012
165548299137,4cyclictest1774886-21latency_hist09:05:012
165548299131,10cyclictest1733261-21awk08:25:002
1655482991310,2cyclictest1938672-21fschecks_time11:40:142
1655482991310,2cyclictest1853617-21unixbench_multi10:15:252
1655482991310,2cyclictest1844122-21cpuspeed_turbos10:10:172
1655482991310,2cyclictest0-21swapper/210:45:012
165547799138,4cyclictest1964195-21kworker/u8:2+flush-259:012:25:201
165547799138,4cyclictest1827030-21ntpq09:50:201
165547799137,5cyclictest1675935-21kworker/u8:1+flush-259:008:55:261
165547799136,5cyclictest1869458-21apt-get10:35:001
1655477991310,2cyclictest1939476-21tr11:40:181
1655477991310,2cyclictest1863915-21unixbench_singl10:25:281
165547499139,3cyclictest1795621-21kworker/u8:0+events_unbound09:30:190
165547499137,4cyclictest2304165-21systemd-journal11:20:020
1655474991312,1cyclictest60650irq/133-enp0s29f1:rx-009:20:260
1655474991311,1cyclictest60650irq/133-enp0s29f1:rx-011:10:120
1655474991311,1cyclictest60650irq/133-enp0s29f1:rx-009:00:250
1655474991310,2cyclictest60650irq/133-enp0s29f1:rx-012:25:250
1655474991310,2cyclictest60650irq/133-enp0s29f1:rx-011:57:170
1655474991310,2cyclictest60650irq/133-enp0s29f1:rx-010:48:590
1655474991310,2cyclictest60650irq/133-enp0s29f1:rx-010:15:180
165547499130,5cyclictest17646262sort08:55:010
165548999129,2cyclictest1959174-21cpuspeed_turbos12:00:133
165548999129,2cyclictest1902067-21cpuspeed_turbos11:05:143
165548999129,2cyclictest1848961-21kworker/u8:0+flush-259:010:45:193
165548999129,2cyclictest1795973-21gpgv09:25:053
165548999120,7cyclictest1764625-21ls08:55:013
165548299129,2cyclictest1984929-21cpuspeed_turbos12:25:162
165548299129,2cyclictest1942968-21kworker/u8:4+flush-259:011:50:292
165548299129,2cyclictest1765262-21irqcore08:55:182
165548299129,2cyclictest0-21swapper/209:20:182
165548299128,3cyclictest1728091-21kworker/u8:2+flush-259:009:13:222
165547799129,2cyclictest1901551-21latency_hist11:05:001
165547799129,2cyclictest1791695-21sort09:20:171
165547799129,2cyclictest1780724-21sed09:10:141
165547799129,2cyclictest1655149-21kworker/u8:2+flush-259:007:30:221
165547799126,4cyclictest2304165-21systemd-journal10:15:001
165547799126,4cyclictest2304165-21systemd-journal07:50:171
165547499129,2cyclictest60650irq/133-enp0s29f1:rx-008:07:260
165547499125,5cyclictest1785432-21/usr/sbin/munin09:15:140
1655474991210,1cyclictest60650irq/133-enp0s29f1:rx-009:45:240
165548999118,2cyclictest1875385-21cpuspeed_turbos10:40:143
165548999118,2cyclictest0-21swapper/308:05:143
165548999118,2cyclictest0-21swapper/307:35:243
165548999118,1cyclictest0-21swapper/312:10:013
165548299117,3cyclictest1796056-21gpgv09:25:052
165547799119,1cyclictest0-21swapper/108:30:181
165547799118,2cyclictest1923028-21cpuspeed_turbos11:25:131
165547799118,1cyclictest0-21swapper/109:35:011
165548999107,2cyclictest1837612-21kworker/u8:3+flush-259:010:15:213
165548299106,3cyclictest1984824-21kworker/u8:3+flush-259:012:30:192
165547799107,2cyclictest1974644-21cpuspeed_turbos12:15:131
165547799107,2cyclictest1875419-21cpuspeed_turbos10:40:151
165547799100,1cyclictest1733929-21ps08:25:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional