You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-29 - 23:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sat Aug 29, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1752212995248,3cyclictest1803917-21kworker/u8:0+flush-259:008:10:253
1752207995148,2cyclictest1887787-21kworker/u8:3+flush-259:009:30:242
1752207995048,2cyclictest1945245-21kworker/u8:3+flush-259:010:30:252
1752204995045,3cyclictest1856688-21apt-get08:50:131
1752202994945,3cyclictest1945245-21kworker/u8:3+flush-259:010:25:130
1752202994945,3cyclictest1945245-21kworker/u8:3+events_unbound10:20:010
1752212994639,5cyclictest1923518-40mandb09:50:283
1752212994541,3cyclictest2013237-21apt-get11:20:113
1752202994542,2cyclictest1841162-21kworker/u8:2+flush-259:009:00:260
1752202994539,4cyclictest1803883-21apt-get08:00:010
1752202994440,3cyclictest1757579-21apt-get07:15:120
1752202994238,3cyclictest1803917-21kworker/u8:0+flush-259:009:15:260
1752202994238,3cyclictest1699365-21kworker/u8:2+flush-259:007:20:260
1752207994137,3cyclictest2038521-21kworker/u8:1+events_unbound11:45:112
1752207994137,3cyclictest1803917-21kworker/u8:0+events_unbound08:40:202
1752204994135,4cyclictest335557-21systemd-journal11:15:001
1752207994037,2cyclictest1871918-21kworker/u8:1+flush-259:009:10:242
1752212993835,2cyclictest1928901-21kworker/u8:2+flush-259:010:20:253
1752207993831,5cyclictest1981567-21apt-get10:50:002
1752212993734,2cyclictest1803917-21kworker/u8:0+events_unbound09:25:153
1752212993733,3cyclictest1997500-21kworker/u8:3+flush-259:011:55:253
1752212993733,3cyclictest1997500-21kworker/u8:3+flush-259:011:50:113
1752207993633,2cyclictest2055712-21kworker/u8:4+events_unbound12:20:212
1752207993431,2cyclictest1804541-21kworker/u8:2+events_unbound08:05:152
1752202993431,2cyclictest1987138-21kworker/u8:2+flush-259:010:55:240
1752207993329,3cyclictest1820793-21kworker/u8:1+events_unbound08:20:242
1752207993326,2cyclictest1945245-21kworker/u8:3+events_unbound10:50:192
1752204993226,4cyclictest1997721-21apt-get11:05:111
1752202993228,3cyclictest1803917-21kworker/u8:0+flush-259:009:20:110
1752207993127,3cyclictest1928901-21kworker/u8:2+events_unbound10:00:192
1752207993127,3cyclictest1803917-21kworker/u8:0+events_unbound08:10:232
1752207993125,2cyclictest2070342-21kworker/u8:2+events_unbound12:30:222
1752212993024,5cyclictest335557-21systemd-journal09:59:593
1752207993026,3cyclictest1820793-21kworker/u8:1+events_unbound08:50:242
1752204993026,3cyclictest1893194-21apt-get09:25:111
1752212992926,2cyclictest1757332-21kworker/u8:1+flush-259:007:55:253
1752212992924,4cyclictest1939419-21latency_hist10:10:003
1752204992924,3cyclictest1840501-21apt-get08:35:011
1752212992823,3cyclictest1746657-21kworker/u8:3+flush-259:008:15:153
1752207992825,2cyclictest1928901-21kworker/u8:2+flush-259:010:10:202
1752207992824,3cyclictest1778268-21apt-get07:35:122
1752202992825,2cyclictest2055712-21kworker/u8:4+flush-259:012:35:170
1752202992825,2cyclictest1945245-21kworker/u8:3+flush-259:010:45:220
1752202992825,2cyclictest1898143-21kworker/u8:2+events_unbound09:35:000
1752202992824,3cyclictest1908406-21kworker/u8:1+flush-259:009:55:130
1752202992824,3cyclictest1841162-21kworker/u8:2+events_unbound09:05:240
1752207992724,2cyclictest2038521-21kworker/u8:1+events_unbound11:50:212
1752207992724,2cyclictest1987138-21kworker/u8:2+events_unbound11:05:232
1752207992724,2cyclictest1945245-21kworker/u8:3+events_unbound10:25:152
1752207992724,2cyclictest1908406-21kworker/u8:1+events_unbound09:55:232
1752202992724,2cyclictest1803917-21kworker/u8:0+flush-259:010:05:260
1752202992723,2cyclictest2038521-21kworker/u8:1+events_unbound11:50:010
1752212992623,3cyclictest1997500-21kworker/u8:3+events_unbound11:40:163
1752207992623,2cyclictest1987138-21kworker/u8:2+events_unbound11:00:242
1752207992623,2cyclictest1887787-21kworker/u8:3+flush-259:009:35:202
1752207992623,2cyclictest1820793-21kworker/u8:1+events_unbound08:25:192
1752207992623,2cyclictest1767644-21kworker/u8:0+events_unbound07:25:222
1752207992623,2cyclictest1757332-21kworker/u8:1+events_unbound07:30:152
1752204992621,3cyclictest1803917-21kworker/u8:0+events_unbound09:20:171
1752207992522,2cyclictest2070342-21kworker/u8:2+flush-259:012:25:202
1752207992522,2cyclictest1928901-21kworker/u8:2+events_unbound10:20:212
1752207992522,2cyclictest1757332-21kworker/u8:1+events_unbound07:55:232
1752207992522,2cyclictest1757332-21kworker/u8:1+events_unbound07:50:222
1752207992522,2cyclictest1757332-21kworker/u8:1+events_unbound07:50:222
1752207992521,3cyclictest1987138-21kworker/u8:2+events_unbound11:00:012
1752207992521,3cyclictest1803917-21kworker/u8:0+events_unbound08:30:192
1752207992521,3cyclictest1746657-21kworker/u8:3+events_unbound07:44:072
1752207992520,4cyclictest1803917-21kworker/u8:0+flush-259:011:10:182
1752202992521,3cyclictest1939929-21cat10:10:010
1752202992520,4cyclictest2049603-21latency_hist11:55:000
1752212992420,3cyclictest2060279-21apt-get12:05:123
1752207992421,2cyclictest1997500-21kworker/u8:3+flush-259:011:30:382
1752207992420,3cyclictest1803917-21kworker/u8:0+events_unbound09:03:092
1752204992418,4cyclictest1924144-21/usr/sbin/munin09:55:161
1752204992418,4cyclictest1820083-21/usr/sbin/munin08:15:131
1752204992418,3cyclictest1945245-21kworker/u8:3+flush-259:010:35:001
1752202992418,4cyclictest1788759-21diskstats07:45:140
1752212992320,2cyclictest1928901-21kworker/u8:2+flush-259:010:10:103
1752212992319,3cyclictest1887787-21kworker/u8:3+flush-259:009:35:153
1752212992319,3cyclictest1803917-21kworker/u8:0+events_unbound09:00:073
1752207992320,2cyclictest1997500-21kworker/u8:3+flush-259:011:40:182
1752207992320,2cyclictest1699365-21kworker/u8:2+events_unbound07:23:072
1752207992319,3cyclictest1746657-21kworker/u8:3+events_unbound08:15:122
1752207992316,6cyclictest2008019-21kworker/u8:2+flush-259:011:25:172
1752204992319,3cyclictest1803917-21kworker/u8:0+flush-259:010:55:261
1752204992318,3cyclictest1919010-21apt-get09:50:121
1752202992320,2cyclictest2028452-21kworker/u8:0+flush-259:011:35:270
1752202992319,3cyclictest2028452-21kworker/u8:0+events_unbound11:40:070
1752212992219,2cyclictest1793776-21apt-get07:50:113
1752212992219,2cyclictest1793776-21apt-get07:50:113
1752212992218,3cyclictest1803917-21kworker/u8:0+flush-259:010:40:213
1752207992219,2cyclictest2055712-21kworker/u8:4+flush-259:012:35:202
1752207992219,2cyclictest2038521-21kworker/u8:1+flush-259:011:55:142
1752207992219,2cyclictest1841162-21kworker/u8:2+events_unbound08:55:212
1752207992218,3cyclictest1997500-21kworker/u8:3+events_unbound12:00:182
1752204992218,3cyclictest1803917-21kworker/u8:0+flush-259:008:50:001
1752204992216,4cyclictest1902344-21ntpq09:30:201
1752204992215,5cyclictest335557-21systemd-journal10:20:291
1752202992219,2cyclictest335480-21sshd09:54:070
1752202992219,2cyclictest1803917-21kworker/u8:0+events_unbound08:15:200
1752202992218,3cyclictest2081418-21apt-get12:25:150
1752202992218,3cyclictest1908402-21systemd-run09:39:590
1752202992217,4cyclictest1767891-21apt-get07:25:120
1752212992118,2cyclictest1945245-21kworker/u8:3+flush-259:010:45:213
1752212992117,3cyclictest1997457-21latency_hist11:05:003
1752207992118,2cyclictest1997500-21kworker/u8:3+events_unbound11:35:162
1752207992117,3cyclictest1820793-21kworker/u8:1+events_unbound08:35:222
1752204992117,3cyclictest1928901-21kworker/u8:2+flush-259:010:00:171
1752204992114,5cyclictest1803883-21apt08:00:001
1752202992115,4cyclictest1752121-21latency_hist07:10:000
1752212992017,2cyclictest1746657-21kworker/u8:3+flush-259:007:35:253
1752212992016,3cyclictest1997500-21kworker/u8:3+flush-259:011:35:403
1752212992015,4cyclictest2044305-21cat11:50:003
1752207992017,2cyclictest1928901-21kworker/u8:2+events_unbound10:15:302
1752207992017,2cyclictest1803917-21kworker/u8:0+flush-259:008:45:252
1752207992017,2cyclictest1803917-21kworker/u8:0+flush-259:008:00:202
1752207992017,2cyclictest1699365-21kworker/u8:2+events_unbound07:15:172
1752207992016,3cyclictest2008019-21kworker/u8:2+events_unbound11:15:172
1752207992016,3cyclictest1803917-21kworker/u8:0+events_unbound09:45:242
1752207992016,3cyclictest1803917-21kworker/u8:0+events_unbound09:17:072
1752204992016,3cyclictest507-21in:imuxsock07:20:001
1752204992016,3cyclictest1746657-21kworker/u8:3+flush-259:008:20:221
1752204992016,3cyclictest1746657-21kworker/u8:3+flush-259:007:45:261
1752204992015,3cyclictest335557-21systemd-journal11:38:071
1752202992017,2cyclictest1987138-21kworker/u8:2+flush-259:011:05:210
1752202992017,2cyclictest1841162-21kworker/u8:2+flush-259:008:45:210
1752202992016,3cyclictest1966149-21kworker/u8:1+events_unbound11:13:000
1752202992016,3cyclictest1803917-21kworker/u8:0+events_unbound08:35:170
1752202992015,4cyclictest2055712-21kworker/u8:4+events_unbound12:09:590
1752202992014,5cyclictest1804052-21cat08:00:000
1752212991917,1cyclictest1699365-21kworker/u8:2+events_unbound07:20:203
1752212991917,1cyclictest0-21swapper/309:10:013
1752207991916,2cyclictest2055712-21kworker/u8:4+flush-259:012:15:262
1752207991916,2cyclictest1803917-21kworker/u8:0+events_unbound09:25:252
1752207991913,4cyclictest1757308-21latency_hist07:15:002
1752204991916,2cyclictest1798730-21idleruntime-cro07:55:001
1752204991916,2cyclictest1798730-21idleruntime-cro07:55:001
1752204991915,3cyclictest1803917-21kworker/u8:0+flush-259:009:15:181
1752204991915,3cyclictest1746657-21kworker/u8:3+flush-259:007:40:001
1752202991916,2cyclictest1997500-21kworker/u8:3+events_unbound12:00:240
1752202991915,3cyclictest1861886-21apt-get08:55:110
1752202991913,4cyclictest1987152-21latency_hist10:55:010
1752212991816,2cyclictest1987138-21kworker/u8:2+events_unbound11:05:063
1752212991815,3cyclictest2008019-21kworker/u8:2+events_unbound11:30:063
1752212991815,2cyclictest1837919-21tr08:30:183
1752212991815,2cyclictest1803917-21kworker/u8:0+events_unbound09:40:163
175221299181,16cyclictest1934262-21unin-run10:05:013
1752207991815,3cyclictest1908406-21kworker/u8:1+events_unbound09:54:552
1752207991813,2cyclictest1803917-21kworker/u8:0+events_unbound10:40:222
1752204991815,2cyclictest2082440-21kthreadcore12:25:211
1752204991814,3cyclictest2028452-21kworker/u8:0+flush-259:011:45:171
1752204991814,3cyclictest1803917-21kworker/u8:0+flush-259:010:05:201
1752204991814,3cyclictest1757332-21kworker/u8:1+flush-259:008:05:001
1752204991813,4cyclictest1966149-21kworker/u8:1+flush-259:010:35:191
1752202991815,2cyclictest509-21rs:main0
1752202991815,2cyclictest1997500-21kworker/u8:3+events_unbound12:10:200
1752202991815,2cyclictest1966149-21kworker/u8:1+flush-259:010:35:190
1752202991813,4cyclictest335557-21systemd-journal10:05:000
1752202991813,4cyclictest335557-21systemd-journal09:45:000
1752202991813,4cyclictest1835352-21latency_hist08:30:010
1752202991811,5cyclictest1839627-21ntpq08:30:210
1752212991715,1cyclictest335557-21systemd-journal10:36:063
1752212991715,1cyclictest2076637-21irqcore12:20:173
1752212991714,2cyclictest1699365-21kworker/u8:2+events_unbound07:15:383
1752212991713,3cyclictest1887787-21kworker/u8:3+events_unbound09:48:083
1752212991713,3cyclictest1767644-21kworker/u8:0+flush-259:007:25:203
1752212991712,4cyclictest1945289-21apt-get10:15:133
1752207991714,2cyclictest1841162-21kworker/u8:2+events_unbound09:05:262
1752207991713,3cyclictest1997500-21kworker/u8:3+events_unbound12:06:082
1752207991712,4cyclictest2008019-21kworker/u8:2+flush-259:011:20:162
1752204991713,3cyclictest1752398-21/usr/sbin/munin07:10:141
1752202991714,2cyclictest60350irq/132-enp0s29f1:rx-011:20:120
1752202991714,2cyclictest60350irq/132-enp0s29f1:rx-008:51:010
1752202991714,2cyclictest1871918-21kworker/u8:1+events_unbound09:10:200
1752202991714,2cyclictest1803917-21kworker/u8:0+events_unbound10:40:170
1752202991711,4cyclictest513-21gdbus07:55:000
1752202991711,4cyclictest513-21gdbus07:55:000
1752212991614,2cyclictest1997500-21kworker/u8:3+events_unbound12:00:213
1752212991614,1cyclictest0-21swapper/309:20:003
1752212991613,2cyclictest2055712-21kworker/u8:4+events_unbound12:15:233
1752212991613,2cyclictest1966149-21kworker/u8:1+events_unbound10:50:273
1752212991613,2cyclictest1820793-21kworker/u8:1+events_unbound08:24:083
175220799169,5cyclictest1908818-21diskstats09:40:122
1752207991612,3cyclictest2055712-21kworker/u8:4+events_unbound12:10:112
1752207991612,3cyclictest1803917-21kworker/u8:0+events_unbound10:07:092
175220499168,6cyclictest1960010-21ntpq10:25:221
1752202991614,1cyclictest60350irq/132-enp0s29f1:rx-010:16:040
1752202991614,1cyclictest60350irq/132-enp0s29f1:rx-008:20:310
1752202991614,1cyclictest60350irq/132-enp0s29f1:rx-007:31:360
1752202991613,2cyclictest60350irq/132-enp0s29f1:rx-008:10:210
1752202991613,2cyclictest60350irq/132-enp0s29f1:rx-007:14:590
1752202991613,2cyclictest2038521-21kworker/u8:1+events_unbound11:55:060
1752202991613,2cyclictest1997500-21kworker/u8:3+events_unbound12:15:430
1752212991513,2cyclictest1945245-21kworker/u8:3+flush-259:010:34:483
1752212991512,2cyclictest1803917-21kworker/u8:0+flush-259:009:20:223
1752212991511,3cyclictest1820793-21kworker/u8:1+events_unbound08:50:143
1752207991510,3cyclictest1892905-21cron09:24:592
1752204991511,3cyclictest1997500-21kworker/u8:3+flush-259:011:59:591
1752204991511,3cyclictest1803917-21kworker/u8:0+events_unbound09:40:221
1752202991513,1cyclictest60350irq/132-enp0s29f1:rx-012:20:230
1752202991513,1cyclictest60350irq/132-enp0s29f1:rx-010:30:180
1752202991512,2cyclictest60350irq/132-enp0s29f1:rx-008:05:170
1752202991512,2cyclictest1787408-21ntp_kernel_err07:40:210
1752202991511,3cyclictest335557-21systemd-journal11:19:080
1752212991412,2cyclictest1804541-21kworker/u8:2+events_unbound08:05:233
1752212991411,2cyclictest2008019-21kworker/u8:2+events_unbound11:25:213
1752212991411,2cyclictest1841162-21kworker/u8:2+events_unbound08:45:163
1752212991410,3cyclictest2008019-21kworker/u8:2+events_unbound11:15:233
1752212991410,3cyclictest1945245-21kworker/u8:3+events_unbound10:25:073
1752212991410,3cyclictest1803917-21kworker/u8:0+events_unbound08:26:083
1752207991411,2cyclictest1789008-21irqcore07:45:162
175220499149,4cyclictest1841162-21kworker/u8:2+flush-259:008:55:241
175220499147,5cyclictest335557-21systemd-journal08:35:001
1752204991410,3cyclictest1997500-21kworker/u8:3+flush-259:011:16:071
1752202991412,1cyclictest60350irq/132-enp0s29f1:rx-011:25:140
1752202991411,2cyclictest60350irq/132-enp0s29f1:rx-012:30:210
1752202991411,2cyclictest60350irq/132-enp0s29f1:rx-009:25:220
1752202991411,2cyclictest60350irq/132-enp0s29f1:rx-007:36:240
1752212991310,2cyclictest2065189-21kworker/u8:0+flush-259:012:34:443
1752212991310,2cyclictest2055712-21kworker/u8:4+events_unbound12:35:223
175220499139,3cyclictest2013460-21fschecks_time11:20:141
175220499137,4cyclictest335557-21systemd-journal09:15:011
1752202991310,2cyclictest1918268-21unixbench_multi09:45:240
175221299129,2cyclictest1851244-21cron08:45:003
175221299129,2cyclictest1803917-21kworker/u8:0+flush-259:011:00:013
175221299129,2cyclictest1746657-21kworker/u8:3+flush-259:007:10:183
175221299128,3cyclictest2055712-21kworker/u8:4+events_unbound12:25:003
175221299128,3cyclictest1871918-21kworker/u8:1+flush-259:009:12:123
1752212991210,1cyclictest0-21swapper/309:00:003
175220499129,2cyclictest2063850-21kthreadcore12:05:181
175220499129,2cyclictest1950185-21idleruntime-cro10:20:001
175220499129,2cyclictest1944538-21unixbench_multi10:10:241
175220499126,4cyclictest2065408-21/usr/sbin/munin12:10:131
1752204991210,1cyclictest2091528-21turbostat12:35:001
1752202991211,1cyclictest60350irq/132-enp0s29f1:rx-011:30:290
1752202991210,1cyclictest60350irq/132-enp0s29f1:rx-011:00:170
175221299119,2cyclictest1746657-21kworker/u8:3+flush-259:007:47:123
175221299117,3cyclictest1757332-21kworker/u8:1+events_unbound07:40:213
175221299117,3cyclictest1746657-21kworker/u8:3+events_unbound08:00:293
175220499119,1cyclictest0-21swapper/112:00:191
175220499118,2cyclictest0-21swapper/112:35:171
175220499117,3cyclictest1820793-21kworker/u8:1+flush-259:008:25:181
175220499116,3cyclictest335557-21systemd-journal11:25:261
175220499110,10cyclictest0-21swapper/112:22:221
175221299105,3cyclictest1841010-21find08:35:013
175220499101,6cyclictest1918745-21turbostat09:50:001
17522129997,1cyclictest0-21swapper/307:30:223
17522049997,1cyclictest0-21swapper/110:50:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional