You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-19 - 10:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sun Jul 19, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1714625995148,2cyclictest75-21kswapd023:15:020
1714634994741,4cyclictest335557-21systemd-journal23:35:003
1714629994437,4cyclictest1850298-21latency_hist21:20:001
1714634994136,3cyclictest2016808-21apt-get00:00:123
1714629994037,2cyclictest75-21kswapd023:15:021
1714634993932,5cyclictest1802566-21latency_hist20:35:013
1714634993827,9cyclictest1694703-21kworker/u8:0+flush-259:019:10:013
1714625993833,3cyclictest1735274-21kworker/u8:1+flush-259:020:15:010
1714634993630,4cyclictest335557-21systemd-journal21:18:253
1714625993531,3cyclictest1969536-21gpgv23:14:590
1714625993527,6cyclictest2000146-21ntpq23:40:220
1714632993428,4cyclictest335557-21systemd-journal19:50:012
1714634993228,3cyclictest1735274-21kworker/u8:1+flush-259:019:55:003
1714632993125,4cyclictest1865801-21latency_hist21:35:002
1714629993126,4cyclictest335557-21systemd-journal20:44:241
1714632993025,3cyclictest1756019-21kworker/u8:0+flush-259:020:15:112
1714629993024,4cyclictest1787112-21latency_hist20:20:011
1714625993023,5cyclictest1995878-21latency_hist23:40:000
1714632992917,10cyclictest1777045-21apt-get20:10:142
1714625992926,2cyclictest1855510-21kworker/u8:0+events_unbound22:25:010
1714625992926,2cyclictest1829918-21kworker/u8:2+flush-259:021:25:220
1714625992925,3cyclictest1969713-21kworker/u8:3+flush-259:023:30:270
1714632992811,3cyclictest1948426-21idleruntime-cro22:55:002
1714629992822,4cyclictest2011642-21apt-get23:55:121
1714625992821,5cyclictest1796508-21ntpq20:25:210
1714629992721,4cyclictest2037636-21latency_hist00:20:011
1714625992722,3cyclictest1756019-21kworker/u8:0+flush-259:020:00:260
1714634992621,3cyclictest1792259-21kworker/u8:3+events_unbound20:45:013
1714634992521,3cyclictest1818147-21gpgv20:50:003
1714634992520,3cyclictest1835106-21apt-get21:05:123
1714632992521,3cyclictest75-21kswapd023:15:022
1714632992521,3cyclictest335557-21systemd-journal22:27:562
1714629992521,3cyclictest1725143-21kworker/u8:4+flush-259:019:44:591
1714625992519,4cyclictest1739525-21ntpq19:30:210
1714625992518,5cyclictest2047072-21ntpq00:25:230
1714632992422,1cyclictest1839997-21kworker/u8:3+flush-259:021:15:002
1714632992420,3cyclictest1766682-21/usr/sbin/munin20:00:232
1714629992419,3cyclictest1735275-21kworker/u8:3+flush-259:020:00:171
1714625992420,3cyclictest507-21in:imuxsock20:20:000
1714634992319,3cyclictest1735274-21kworker/u8:1+flush-259:020:25:013
1714634992317,4cyclictest1943283-21latency_hist22:50:013
1714632992319,3cyclictest1855510-21kworker/u8:0+flush-259:021:40:102
1714629992317,4cyclictest1776784-21latency_hist20:10:011
1714625992318,3cyclictest1938152-21kworker/u8:0+flush-259:023:00:000
1714634992218,3cyclictest1985558-21kworker/u8:4+flush-259:023:50:193
1714634992217,3cyclictest2021760-21kworker/u8:0+flush-259:000:05:223
1714634992216,4cyclictest1927563-21kworker/u8:1+flush-259:023:40:183
171463299228,5cyclictest335557-21systemd-journal21:01:242
1714632992218,3cyclictest1812942-21kworker/u8:0+flush-259:020:45:242
1714632992216,4cyclictest2048194-21/usr/sbin/munin00:30:142
1714629992218,3cyclictest1724656-21kworker/u8:2+flush-259:019:25:001
1714629992218,3cyclictest1724656-21kworker/u8:2+flush-259:019:25:001
1714625992219,2cyclictest1876167-21kworker/u8:2+events_unbound22:05:170
1714625992217,4cyclictest1735275-21kworker/u8:3+events_unbound19:45:000
1714625992216,4cyclictest335557-21systemd-journal00:02:250
1714634992118,1cyclictest0-21swapper/320:59:593
1714634992116,3cyclictest1969713-21kworker/u8:3+flush-259:023:25:263
1714634992116,3cyclictest1928039-21apt-get22:35:123
1714634992113,6cyclictest2053285-21cp00:35:003
171463299218,2cyclictest2016536-21sh00:00:002
1714629992116,3cyclictest1958961-21gpgv23:05:011
1714625992117,2cyclictest1829918-21kworker/u8:2+flush-259:021:30:240
1714625992116,4cyclictest1855510-21kworker/u8:0+events_unbound22:10:180
1714634992018,1cyclictest1907028-21kworker/u8:3+flush-259:022:22:553
1714634992017,2cyclictest1901881-21cron22:10:003
1714634992016,3cyclictest1876167-21kworker/u8:2+events_unbound00:20:203
1714634992012,5cyclictest1806946-21ntpq20:35:233
1714632992016,3cyclictest2043012-21kworker/u8:3+flush-259:000:25:172
1714632992014,4cyclictest1980268-21latency_hist23:25:012
1714629992018,1cyclictest1735274-21kworker/u8:1+events_unbound19:35:181
1714625992017,2cyclictest1876167-21kworker/u8:2+flush-259:023:30:000
1714625992016,3cyclictest1876167-21kworker/u8:2+flush-259:023:00:190
1714625992016,3cyclictest1665920-21kworker/u8:1+flush-259:019:15:000
1714625992015,3cyclictest1824241-21base6420:55:000
1714634991914,3cyclictest2053178-21apt-get00:35:033
1714634991913,4cyclictest1970019-21base6423:15:003
1714634991913,4cyclictest1855510-21kworker/u8:0+flush-259:022:00:213
1714634991912,5cyclictest1891581-21latency_hist22:00:013
171463299199,9cyclictest1740694-21/usr/sbin/munin19:35:202
1714632991916,2cyclictest1912229-21idleruntime-cro22:20:002
1714632991915,3cyclictest1886421-21sh21:55:002
1714632991914,4cyclictest335557-21systemd-journal00:20:012
1714632991914,4cyclictest2006469-21apt-get23:50:142
1714629991916,2cyclictest2047948-21idleruntime-cro00:30:001
1714625991916,2cyclictest509-21rs:main0
1714625991913,4cyclictest1730356-21apt-get19:25:130
1714625991912,5cyclictest1911306-21ntpq22:15:180
1714634991814,3cyclictest1735275-21kworker/u8:3+flush-259:019:45:153
171463299185,4cyclictest1855732-21apt-get21:25:132
1714632991815,2cyclictest1942412-21ntp_kernel_pll_22:45:232
1714632991813,4cyclictest335557-21systemd-journal22:35:002
1714632991813,4cyclictest335557-21systemd-journal21:10:002
1714632991812,4cyclictest1870975-21latency_hist21:40:002
171462999184,3cyclictest1932075-21ld22:35:211
171462999183,6cyclictest1791467-21proc_pri20:20:241
171462999183,4cyclictest490-21dbus-daemon00:05:011
1714629991815,2cyclictest1917685-21apt-get22:25:131
1714625991814,3cyclictest1927563-21kworker/u8:1+flush-259:022:45:000
1714625991811,5cyclictest335557-21systemd-journal23:25:000
1714625991811,5cyclictest2031132-21ntpq00:10:200
1714634991714,2cyclictest1876167-21kworker/u8:2+events_unbound23:45:253
1714634991713,3cyclictest1876167-21kworker/u8:2+flush-259:023:00:253
1714634991713,3cyclictest1735275-21kworker/u8:3+flush-259:019:35:003
1714634991713,2cyclictest0-21swapper/319:20:003
1714634991713,2cyclictest0-21swapper/319:20:003
171463499171,2cyclictest1776788-21munin-run20:10:003
1714634991712,4cyclictest1932905-21kworker/u8:3+events_unbound22:40:023
1714634991712,4cyclictest1735274-21kworker/u8:1+events_unbound20:10:193
1714634991710,5cyclictest1822776-21ntpq20:50:213
171463499170,15cyclictest1855492-21munin-run21:25:003
171463299175,2cyclictest1932940-21idleruntime-cro22:40:002
1714632991715,1cyclictest0-21swapper/219:45:002
1714632991711,5cyclictest1880477-21ntpq21:45:252
171463299170,16cyclictest61-21kcompactd019:20:152
171463299170,16cyclictest61-21kcompactd019:20:142
171462999177,2cyclictest1926875-21ntpq22:30:201
1714629991714,2cyclictest1876412-21apt-get21:45:151
1714629991713,2cyclictest0-21swapper/120:50:001
1714629991711,4cyclictest1854608-21ntpq21:20:221
1714625991712,4cyclictest1845392-21/usr/sbin/munin21:15:170
171463499169,4cyclictest2032328-21cat00:15:003
1714634991612,3cyclictest507-21in:imuxsock21:55:003
1714634991612,3cyclictest1871637-21grep21:40:143
1714634991612,3cyclictest1855510-21kworker/u8:0+events_unbound21:50:003
1714634991612,3cyclictest1855510-21kworker/u8:0+events_unbound21:35:233
1714634991612,3cyclictest1756019-21kworker/u8:0+flush-259:020:00:003
1714634991611,3cyclictest1756019-21kworker/u8:0+flush-259:020:25:253
1714632991610,4cyclictest335557-21systemd-journal22:55:242
1714632991610,4cyclictest1989844-21ntpq23:30:222
171462999165,3cyclictest2010483-21ntpq23:50:221
171462999164,10cyclictest1802092-21sed20:30:241
1714629991613,2cyclictest1735275-21kworker/u8:3+flush-259:019:45:201
1714629991611,3cyclictest1907295-21/usr/sbin/munin22:15:211
1714625991614,1cyclictest60350irq/132-enp0s29f1:rx-021:20:170
1714625991614,1cyclictest60350irq/132-enp0s29f1:rx-021:06:560
1714625991614,1cyclictest60350irq/132-enp0s29f1:rx-020:50:190
1714625991614,1cyclictest60350irq/132-enp0s29f1:rx-020:45:100
1714625991613,2cyclictest61150irq/133-enp0s29f1:tx-022:45:130
1714625991613,2cyclictest60350irq/132-enp0s29f1:rx-000:05:130
1714625991613,2cyclictest1876133-21sh21:45:000
1714625991612,3cyclictest1876167-21kworker/u8:2+flush-259:023:55:000
1714625991612,2cyclictest2042788-21turbostat00:25:000
171463499159,4cyclictest1990987-21apt-get23:35:143
171463499154,2cyclictest0-21swapper/321:05:003
1714634991511,3cyclictest1876167-21kworker/u8:2+events_unbound00:15:233
1714634991511,3cyclictest1694703-21kworker/u8:0+flush-259:019:25:293
171463299154,2cyclictest0-21swapper/220:30:162
1714632991512,2cyclictest1993280-21tr23:35:212
1714632991511,3cyclictest1855510-21kworker/u8:0+flush-259:022:10:252
1714632991511,3cyclictest1829261-21apt-get21:00:002
1714632991511,3cyclictest1735274-21kworker/u8:1+flush-259:020:40:012
1714632991511,3cyclictest1665920-21kworker/u8:1+flush-259:019:10:242
171462999159,5cyclictest1916500-21ntpq22:20:221
171462999158,5cyclictest2053193-21cut00:35:011
171462999157,5cyclictest1824388-21apt-get20:55:121
171462999153,3cyclictest1865609-21runrttasks21:32:521
171462999153,2cyclictest1969108-21users23:10:251
171462599159,5cyclictest1881296-21latency_hist21:50:000
1714625991513,1cyclictest60350irq/132-enp0s29f1:rx-022:40:010
1714625991513,1cyclictest60350irq/132-enp0s29f1:rx-022:30:160
1714625991513,1cyclictest60350irq/132-enp0s29f1:rx-020:21:580
1714625991513,1cyclictest60350irq/132-enp0s29f1:rx-020:07:100
1714625991513,1cyclictest60350irq/132-enp0s29f1:rx-019:23:560
1714625991513,1cyclictest60350irq/132-enp0s29f1:rx-019:23:560
1714625991512,2cyclictest60350irq/132-enp0s29f1:rx-021:58:360
1714625991512,2cyclictest60350irq/132-enp0s29f1:rx-020:35:260
1714625991512,2cyclictest60350irq/132-enp0s29f1:rx-019:55:210
1714625991510,4cyclictest335557-21systemd-journal22:05:000
1714625991510,4cyclictest1881558-21apt-get21:50:120
1714634991411,2cyclictest1943964-21irqcore22:50:173
1714634991410,3cyclictest500-21systemd-logind22:15:003
1714634991410,3cyclictest1829918-21kworker/u8:2+flush-259:021:25:283
1714632991411,2cyclictest1894133-21tr22:00:192
1714632991411,1cyclictest0-21swapper/222:45:012
171462999148,5cyclictest335557-21systemd-journal21:03:241
171462999144,7cyclictest1735414-21date19:30:011
171462999144,2cyclictest1937218-21ntpq22:40:201
171462999143,2cyclictest1781078-21ntpq20:10:241
1714629991410,3cyclictest1969713-21kworker/u8:3+flush-259:023:30:191
1714625991413,1cyclictest60350irq/132-enp0s29f1:rx-020:30:150
1714625991412,1cyclictest60350irq/132-enp0s29f1:rx-022:50:160
1714625991412,1cyclictest60350irq/132-enp0s29f1:rx-000:35:130
1714625991412,1cyclictest60350irq/132-enp0s29f1:rx-000:30:210
1714625991411,2cyclictest60350irq/132-enp0s29f1:rx-023:45:060
1714625991411,2cyclictest60350irq/132-enp0s29f1:rx-023:05:090
1714625991411,2cyclictest60350irq/132-enp0s29f1:rx-021:04:290
1714625991411,2cyclictest60350irq/132-enp0s29f1:rx-000:15:240
171463499139,3cyclictest1829918-21kworker/u8:2+events_unbound21:30:153
171463499139,2cyclictest0-21swapper/322:30:003
171463499136,5cyclictest513-21gdbus23:15:003
1714634991311,1cyclictest1714620-21cyclictest22:30:183
171463299138,3cyclictest1735275-21kworker/u8:3+flush-259:019:55:172
171463299137,4cyclictest1886661-21/usr/sbin/munin21:55:192
1714632991310,2cyclictest2022125-21cpuspeed_turbos00:05:142
1714632991310,2cyclictest1958767-21idleruntime-cro23:05:002
1714632991310,1cyclictest0-21swapper/200:25:002
171462999138,3cyclictest1885600-21ntpq21:50:231
171462999138,3cyclictest1765592-21ntpq19:55:211
171462999137,4cyclictest513-21gdbus20:30:011
171462999137,4cyclictest1948434-21latency_hist22:55:021
171462999137,4cyclictest1807777-21dump-pmu-power20:40:011
171462999137,3cyclictest1896992-21apt-get22:05:121
171462999136,6cyclictest2022398-21sed00:05:171
171462999136,5cyclictest2001696-21irqcore23:45:171
171462999136,5cyclictest1985542-21grep23:29:591
171462999134,8cyclictest0-21swapper/100:20:171
171462999133,2cyclictest1994979-21ntpq23:35:241
171462999133,2cyclictest1975639-21fw_forwarded_lo23:20:171
171462999133,2cyclictest1839988-21munin-run21:10:001
171462999133,2cyclictest1724922-21munin-run19:20:001
171462999133,2cyclictest1724922-21munin-run19:20:001
171462999132,4cyclictest2031333-21sensors_temp00:10:241
171462999130,4cyclictest20542262iwlist00:35:151
1714625991312,1cyclictest60350irq/132-enp0s29f1:rx-019:17:080
1714625991312,1cyclictest60350irq/132-enp0s29f1:rx-019:17:070
1714625991311,1cyclictest60350irq/132-enp0s29f1:rx-020:40:120
1714625991311,1cyclictest60350irq/132-enp0s29f1:rx-019:45:250
1714625991310,2cyclictest60350irq/132-enp0s29f1:rx-023:55:200
171463499129,2cyclictest1953116-21unixbench_multi22:55:273
171463499129,2cyclictest1840650-21irqcore21:10:173
171463499127,3cyclictest1907028-21kworker/u8:3+flush-259:022:15:153
171463499127,3cyclictest1724656-21kworker/u8:2+flush-259:019:20:243
171463499127,3cyclictest1724656-21kworker/u8:2+flush-259:019:20:243
1714634991210,1cyclictest0-21swapper/319:35:253
171463299129,2cyclictest500-21systemd-logind20:25:012
171463299129,2cyclictest0-21swapper/223:05:172
171463299129,1cyclictest0-21swapper/200:35:222
171462999129,2cyclictest1840306-21cpuspeed_turbos21:10:141
171462999129,1cyclictest1866060-21apt-get21:35:121
171462999128,3cyclictest0-21swapper/122:00:001
171462999127,4cyclictest1952175-21kthreadcore22:55:191
171462999127,3cyclictest2001021-21idleruntime-cro23:44:591
171462999127,3cyclictest1892270-21sed22:00:161
171462999127,3cyclictest1718858-21ntpq19:10:211
171462999126,4cyclictest1856140-21grep21:25:181
171462999125,5cyclictest1760396-21nvmesmart_nvme019:50:241
171462999124,6cyclictest1904295-21cut22:10:181
171462999124,6cyclictest1873302-21cut21:40:151
171462999124,6cyclictest1740520-21sed19:35:011
171462999124,5cyclictest1938391-21apt22:45:121
1714625991210,1cyclictest60350irq/132-enp0s29f1:rx-022:25:050
1714625991210,1cyclictest60350irq/132-enp0s29f1:rx-019:51:090
1714625991210,1cyclictest60350irq/132-enp0s29f1:rx-019:35:240
171463499119,1cyclictest0-21swapper/319:40:133
171463499115,4cyclictest335557-21systemd-journal00:30:003
171463499115,4cyclictest1980291-21systemd-run23:25:003
171463299118,2cyclictest1996230-21cpuspeed_turbos23:40:132
171463299117,3cyclictest401ktimers/221:15:162
171463299117,3cyclictest1968715-21open_inodes23:10:222
171463299107,2cyclictest1917010-21unixbench_singl22:20:272
171463299107,2cyclictest1757285-21sort19:50:182
171463299101,7cyclictest1901878-21awk22:10:002
17146329997,1cyclictest0-21swapper/220:05:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional